Page MenuHomePhabricator

Upgrade Varnish from 6.0 to 7.1
Closed, ResolvedPublic

Description

We’re lagging behind on upgrading versions: We’re on Varnish 6.0, Varnish has been on 7.X for a while now.

6.0 Is marked as “supported” on Varnish's site but we’re not sure for how long this will last. Varnish maintainers on IRC did not give any clues/answers when probed about the support long-term.

We've been building Varnish from upstream sources but we should be fine to move to Debian's distribution package version, which is on 7.1 for Bookworm. Trixie is on 7.6 but that Debian version doesn’t yet have a release date announced. Debian typically has been releasing every two years so it seems likeliest that they will release Q1 2025. For now, let's just work towards 7.1.

We currently carry three patches: two are backports and one is a small custom patch. Only the transit_buffer patch needs re-backporting.

Despite us moving to Bookworm's version of 7.1, we're still going to be running Bullseye as cp hosts cannot yet be upgraded due to some blocking issues (such as T352744).

Upgrades will follow the Varnish upgrade notes. Of note is the PCRE → PCRE2 replacement in 7.0 as this likely affects requestctl and requires work there.

  • eqiad
  • codfw
  • esams
  • ulsfo
  • eqsin
  • drmrs
  • magru

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
operations/puppetproduction+1 -1
operations/puppetproduction+7 -364
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+2 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+0 -9
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+3 -0
operations/puppetproduction+9 -1
operations/puppetproduction+4 -1
operations/puppetproduction+83 -17
operations/puppetproduction+1 -1
operations/puppetproduction+9 -1
operations/puppetproduction+1 -0
Show related patches Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Rebuild against Varnish 7.1.1-1.1 (release 0.4-3)repos/sre/libvmod-querysort!2brettbullseye-wikimedia-7-1-rebuildbullseye-wikimedia
Backport transit_buffer patchrepos/sre/varnish!1brettbullseye-wikimedia-7-1-patch-backportsbullseye-wikimedia-7-1
Update from private pointer to new private methodsrepos/sre/libvmod-netmapper!3brett6-6-private-method-changesmain
Customize query in GitLab

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Change #1131382 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp6016 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131382

Change #1131367 merged by BCornwall:

[operations/puppet@production] upgrade cp6001 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131367

Change #1131382 merged by BCornwall:

[operations/puppet@production] upgrade cp6016 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131382

Change #1131368 merged by BCornwall:

[operations/puppet@production] upgrade cp6002 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131368

Change #1131381 merged by BCornwall:

[operations/puppet@production] upgrade cp6015 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131381

Change #1131369 merged by BCornwall:

[operations/puppet@production] upgrade cp6003 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131369

Change #1131380 merged by BCornwall:

[operations/puppet@production] upgrade cp6014 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131380

Change #1131370 merged by BCornwall:

[operations/puppet@production] upgrade cp6004 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131370

Change #1131379 merged by BCornwall:

[operations/puppet@production] upgrade cp6013 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131379

Change #1131371 merged by BCornwall:

[operations/puppet@production] upgrade cp6005 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131371

Change #1131378 merged by BCornwall:

[operations/puppet@production] upgrade cp6012 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131378

Change #1131372 merged by BCornwall:

[operations/puppet@production] upgrade cp6006 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131372

Change #1131377 merged by BCornwall:

[operations/puppet@production] upgrade cp6011 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131377

Change #1131373 merged by BCornwall:

[operations/puppet@production] upgrade cp6007 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131373

Change #1131376 merged by BCornwall:

[operations/puppet@production] upgrade cp6010 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131376

Change #1131374 merged by BCornwall:

[operations/puppet@production] upgrade cp6008 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131374

Change #1131375 merged by BCornwall:

[operations/puppet@production] upgrade cp6009 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131375

Change #1131752 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2027 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131752

Change #1131753 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2028 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131753

Change #1131754 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2029 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131754

Change #1131755 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2030 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131755

Change #1131756 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2031 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131756

Change #1131757 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2032 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131757

Change #1131758 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2033 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131758

Change #1131759 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2034 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131759

Change #1131760 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2035 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131760

Change #1131761 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2036 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131761

Change #1131762 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2037 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131762

Change #1131763 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2038 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131763

Change #1131764 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2039 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131764

Change #1131765 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2040 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131765

Change #1131766 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2041 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131766

Change #1131767 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp2042 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131767

Change #1131752 merged by BCornwall:

[operations/puppet@production] upgrade cp2027 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131752

Change #1131753 merged by BCornwall:

[operations/puppet@production] upgrade cp2028 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131753

Change #1131754 merged by BCornwall:

[operations/puppet@production] upgrade cp2029 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131754

Change #1131755 merged by BCornwall:

[operations/puppet@production] upgrade cp2030 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131755

Change #1131756 merged by BCornwall:

[operations/puppet@production] upgrade cp2031 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131756

Change #1131757 merged by BCornwall:

[operations/puppet@production] upgrade cp2032 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131757

Change #1131758 merged by BCornwall:

[operations/puppet@production] upgrade cp2033 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131758

Change #1131759 merged by BCornwall:

[operations/puppet@production] upgrade cp2034 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131759

Change #1131760 merged by BCornwall:

[operations/puppet@production] upgrade cp2035 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131760

Change #1131761 merged by BCornwall:

[operations/puppet@production] upgrade cp2036 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131761

Change #1131762 merged by BCornwall:

[operations/puppet@production] upgrade cp2037 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131762

Change #1131763 merged by BCornwall:

[operations/puppet@production] upgrade cp2038 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131763

Change #1131764 merged by BCornwall:

[operations/puppet@production] upgrade cp2039 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131764

Change #1131765 merged by BCornwall:

[operations/puppet@production] upgrade cp2040 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131765

Change #1131766 merged by BCornwall:

[operations/puppet@production] upgrade cp2041 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131766

Change #1131767 merged by BCornwall:

[operations/puppet@production] upgrade cp2042 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131767

Change #1131824 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1100 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131824

Change #1131825 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1101 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131825

Change #1131826 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1102 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131826

Change #1131827 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1103 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131827

Change #1131828 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1104 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131828

Change #1131829 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1105 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131829

Change #1131830 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1106 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131830

Change #1131831 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1107 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131831

Change #1131832 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1108 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131832

Change #1131833 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1109 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131833

Change #1131834 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1110 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131834

Change #1131835 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1111 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131835

Change #1131836 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1112 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131836

Change #1131837 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1113 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131837

Change #1131838 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1114 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131838

Change #1131839 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] upgrade cp1115 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131839

Change #1131824 merged by BCornwall:

[operations/puppet@production] upgrade cp1100 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131824

Change #1131825 merged by BCornwall:

[operations/puppet@production] upgrade cp1101 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131825

Change #1131826 merged by BCornwall:

[operations/puppet@production] upgrade cp1102 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131826

Change #1131827 merged by BCornwall:

[operations/puppet@production] upgrade cp1103 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131827

Change #1131828 merged by BCornwall:

[operations/puppet@production] upgrade cp1104 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131828

Change #1131829 merged by BCornwall:

[operations/puppet@production] upgrade cp1105 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131829

Change #1131830 merged by BCornwall:

[operations/puppet@production] upgrade cp1106 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131830

Change #1131831 merged by BCornwall:

[operations/puppet@production] upgrade cp1107 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131831

Change #1131832 merged by BCornwall:

[operations/puppet@production] upgrade cp1108 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131832

Change #1131833 merged by BCornwall:

[operations/puppet@production] upgrade cp1109 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131833

Change #1131834 merged by BCornwall:

[operations/puppet@production] upgrade cp1110 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131834

Change #1131835 merged by BCornwall:

[operations/puppet@production] upgrade cp1111 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131835

Change #1131836 merged by BCornwall:

[operations/puppet@production] upgrade cp1112 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131836

Change #1131837 merged by BCornwall:

[operations/puppet@production] upgrade cp1113 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131837

Change #1131838 merged by BCornwall:

[operations/puppet@production] upgrade cp1114 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131838

Change #1131839 merged by BCornwall:

[operations/puppet@production] upgrade cp1115 to Varnish 7.1

https://gerrit.wikimedia.org/r/1131839

BCornwall updated the task description. (Show Details)

Change #1132765 had a related patch set uploaded (by BCornwall; author: BCornwall):

[operations/puppet@production] varnish: Remove support for below version 7

https://gerrit.wikimedia.org/r/1132765

Mentioned in SAL (#wikimedia-operations) [2025-04-01T17:22:51Z] <brett> importing varnish 7.1.1-1.1~bpo11+wmf1 into bullseye-wikimedia main (T378737)

Mentioned in SAL (#wikimedia-operations) [2025-04-01T17:23:19Z] <brett> importing varnish-modules 0.20.0-2~bpo11 into bullseye-wikimedia main (T378737)

Mentioned in SAL (#wikimedia-operations) [2025-04-01T17:24:18Z] <brett> importing libvmod-netmapper 1.9.1-1 into bullseye-wikimedia main (T378737)

Mentioned in SAL (#wikimedia-operations) [2025-04-01T17:24:46Z] <brett> importing libvmod-querysort 0.4-3 into bullseye-wikimedia main (T378737)

Mentioned in SAL (#wikimedia-operations) [2025-04-01T17:25:18Z] <brett> importing libvmod-re2/varnish-re2 2.0.0-2~bpo11+wmf2 into bullseye-wikimedia main (T378737)

Mentioned in SAL (#wikimedia-operations) [2025-04-01T17:25:49Z] <brett> importing varnishkafka 1.2.0-1 into bullseye-wikimedia main (T378737)

Mentioned in SAL (#wikimedia-operations) [2025-04-07T17:04:26Z] <brett> Disabling puppet on A:cp to roll out removal of vanrish 6/7 template switching (T378737)

Change #1132765 merged by BCornwall:

[operations/puppet@production] varnish: Remove support for below version 7

https://gerrit.wikimedia.org/r/1132765

Mentioned in SAL (#wikimedia-operations) [2025-04-07T17:17:10Z] <brett> Re-enabling Puppet on A:cp (T378737)

Change #1138834 had a related patch set uploaded (by Vgutierrez; author: Vgutierrez):

[operations/puppet@production] varnish: Fix docker tests

https://gerrit.wikimedia.org/r/1138834

Change #1138834 merged by Vgutierrez:

[operations/puppet@production] varnish: Fix docker tests

https://gerrit.wikimedia.org/r/1138834