Page MenuHomePhabricator
Create Task
Maniphest T131503

Convert text cluster to Varnish 4
Closed, ResolvedPublic
Actions

Details

SubjectRepoBranchLines +/-
cache_text: route esams back to eqiadoperations/puppetproduction+1 -1
cache_text: route codfw back to eqiadoperations/puppetproduction+1 -1
cache_text: upgrade eqiad to Varnish 4operations/puppetproduction+1 -4
cache_text: upgrade esams to Varnish 4operations/puppetproduction+1 -0
cache_text esams: route to codfwoperations/puppetproduction+1 -1
Text VCL: fixup beresp.Cookie for Vary before hfpoperations/puppetproduction+12 -8
VCL: add backend_response_early hooksoperations/puppetproduction+18 -0
Text VCL: avoid creating empty Cookie headeroperations/puppetproduction+8 -5
cache_text: upgrade ulsfo to Varnish 4operations/puppetproduction+1 -0
cache_text: route ulsfo to codfwoperations/puppetproduction+1 -1
cache_text varnishtest: proper caching of mangled requestsoperations/puppetproduction+41 -1
cache_text: switch to file storage backend on Varnish 4operations/puppetproduction+8 -1
Text VCL: Fix cookie handling for Varnish4operations/puppetproduction+15 -0
cache_text: use file storageoperations/puppetproduction+11 -11
cache_text: upgrade codfw to Varnish 4operations/puppetproduction+1 -0
cache_text: route codfw straight to applayeroperations/puppetproduction+1 -1
cache_text: route around codfw in cache::route_tableoperations/puppetproduction+1 -1
cache_text varnishtest: beacon and CPoperations/puppetproduction+51 -0
cache_text varnishtest: set X-Carrier based on XCIPoperations/puppetproduction+31 -0
cache_text varnishtest: insecure POST forbiddenoperations/puppetproduction+28 -0
cache_text varnishtest: frontend response headersoperations/puppetproduction+34 -0
cache_text varnishtest: set X-Carrier based on XCIPoperations/puppetproduction+21 -0
cp1008: set varnish::dynamic_directors to falseoperations/puppetproduction+1 -0
Point pinkunicorn's varnish-fe to its own varnish-beoperations/puppetproduction+5 -0
Upgrade cp1008 to Varnish 4operations/puppetproduction+1 -0
Text VCL forward-port to Varnish 4operations/puppetproduction+145 -33
cache_text frontend VCL: backend_fetch vs misspassoperations/puppetproduction+7 -1
cache_text backend VCL: use bereq in misspass_mangleoperations/puppetproduction+6 -6
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
BBlack added a parent task: T99226: Switch Varnish's GeoIP code to libmaxminddb/GeoIP2.Apr 25 2016, 3:05 PM
• MZMcBride subscribed.May 9 2016, 2:29 PM
BBlack removed a parent task: T99226: Switch Varnish's GeoIP code to libmaxminddb/GeoIP2.Aug 17 2016, 7:29 PM
• ema moved this task from Backlog to Varnish v4 on the Traffic board.Sep 30 2016, 2:45 PM
gerritbot subscribed.Oct 7 2016, 4:14 PM

Change 314715 had a related patch set uploaded (by Ema):
cache_text backend VCL: use bereq in misspass_mangle

https://gerrit.wikimedia.org/r/314715

gerritbot added a project: Patch-For-Review.Oct 7 2016, 4:14 PM

Change 314716 had a related patch set uploaded (by Ema):
WIP: Text VCL forward-port to Varnish 4

https://gerrit.wikimedia.org/r/314716

gerritbot added a comment.Oct 10 2016, 1:57 PM

Change 314715 merged by BBlack:
cache_text backend VCL: use bereq in misspass_mangle

https://gerrit.wikimedia.org/r/314715

gerritbot added a comment.Oct 11 2016, 9:28 AM

Change 315219 had a related patch set uploaded (by Ema):
cache_text frontend VCL: backend_fetch vs misspass

https://gerrit.wikimedia.org/r/315219

gerritbot added a comment.Oct 11 2016, 9:40 AM

Change 315219 merged by Ema:
cache_text frontend VCL: backend_fetch vs misspass

https://gerrit.wikimedia.org/r/315219

gerritbot added a comment.Oct 12 2016, 3:56 PM

Change 314716 merged by Ema:
Text VCL forward-port to Varnish 4

https://gerrit.wikimedia.org/r/314716

gerritbot added a comment.Oct 13 2016, 11:26 AM

Change 315662 had a related patch set uploaded (by Ema):
Upgrade cp1008 to Varnish 4

https://gerrit.wikimedia.org/r/315662

gerritbot added a comment.Oct 13 2016, 11:32 AM

Change 315662 merged by Ema:
Upgrade cp1008 to Varnish 4

https://gerrit.wikimedia.org/r/315662

gerritbot added a comment.Oct 14 2016, 9:50 AM

Change 315920 had a related patch set uploaded (by Ema):
Point pinkunicorn's varnish-fe to its own varnish-be

https://gerrit.wikimedia.org/r/315920

gerritbot added a comment.Oct 14 2016, 10:33 AM

Change 315920 merged by Ema:
Point pinkunicorn's varnish-fe to its own varnish-be

https://gerrit.wikimedia.org/r/315920

gerritbot added a comment.Oct 14 2016, 1:01 PM

Change 315944 had a related patch set uploaded (by Ema):
cp1008: set varnish::dynamic_directors to false

https://gerrit.wikimedia.org/r/315944

gerritbot added a comment.Oct 14 2016, 1:05 PM

Change 315944 merged by Ema:
cp1008: set varnish::dynamic_directors to false

https://gerrit.wikimedia.org/r/315944

• Gilles mentioned this in T70861: Performance review #2 of Hovercards (Popups extension).Oct 24 2016, 10:59 AM
gerritbot added a comment.Oct 27 2016, 11:00 AM

Change 318276 had a related patch set uploaded (by Ema):
cache_text varnishtest: frontend response headers

https://gerrit.wikimedia.org/r/318276

gerritbot added a comment.Oct 27 2016, 1:05 PM

Change 318287 had a related patch set uploaded (by Ema):
cache_text varnishtest: insecure POST forbidden

https://gerrit.wikimedia.org/r/318287

gerritbot added a comment.Oct 27 2016, 1:48 PM

Change 318291 had a related patch set uploaded (by Ema):
cache_text varnishtest: set X-Carrier based on XCIP

https://gerrit.wikimedia.org/r/318291

gerritbot added a comment.Oct 27 2016, 2:14 PM

Change 318291 abandoned by Ema:
cache_text varnishtest: set X-Carrier based on XCIP

https://gerrit.wikimedia.org/r/318291

gerritbot added a comment.Oct 27 2016, 2:53 PM

Change 318276 merged by Ema:
cache_text varnishtest: frontend response headers

https://gerrit.wikimedia.org/r/318276

gerritbot added a comment.Oct 27 2016, 2:54 PM

Change 318287 merged by Ema:
cache_text varnishtest: insecure POST forbidden

https://gerrit.wikimedia.org/r/318287

gerritbot added a comment.Oct 28 2016, 11:08 AM

Change 318519 had a related patch set uploaded (by Ema):
cache_text varnishtest: set X-Carrier based on XCIP

https://gerrit.wikimedia.org/r/318519

gerritbot added a comment.Oct 28 2016, 3:05 PM

Change 318519 merged by Ema:
cache_text varnishtest: set X-Carrier based on XCIP

https://gerrit.wikimedia.org/r/318519

gerritbot added a comment.Oct 31 2016, 3:30 PM

Change 318946 had a related patch set uploaded (by Ema):
cache_text varnishtest: beacon and CP

https://gerrit.wikimedia.org/r/318946

gerritbot added a comment.Nov 1 2016, 10:03 AM

Change 318946 merged by Ema:
cache_text varnishtest: beacon and CP

https://gerrit.wikimedia.org/r/318946

• ema added a comment.Nov 2 2016, 3:44 PM

While upgrading cache_upload (T131502) we've noticed issues when varnish 4 fetches from varnish 3. To avoid those problems with the cache_text transition to v4 we're planning to:

  • Make ulsfo fetch from eqiad instead of codfw
  • Make codfw fetch straight from the applayer instead of eqiad
  • Upgrade cache_text codfw to varnish 4

At that point we'll be able to observe closely codfw's behavior (v4-only).

Assuming everything goes fine up to this point, we can start testing the behavior of v4<->v4 by routing ulsfo to codfw and upgrading ulsfo to v4.

gerritbot added a comment.Nov 2 2016, 3:45 PM

Change 319345 had a related patch set uploaded (by Ema):
cache_text: route around codfw in cache::route_table

https://gerrit.wikimedia.org/r/319345

gerritbot added a comment.Nov 2 2016, 3:52 PM

Change 319347 had a related patch set uploaded (by Ema):
cache_text: route codfw straight to applayer

https://gerrit.wikimedia.org/r/319347

gerritbot added a comment.Nov 2 2016, 4:02 PM

Change 319351 had a related patch set uploaded (by Ema):
cache_text: upload codfw to Varnish 4

https://gerrit.wikimedia.org/r/319351

gerritbot added a comment.Nov 3 2016, 6:41 AM

Change 319345 merged by Ema:
cache_text: route around codfw in cache::route_table

https://gerrit.wikimedia.org/r/319345

gerritbot added a comment.Nov 3 2016, 7:25 AM

Change 319347 merged by Ema:
cache_text: route codfw straight to applayer

https://gerrit.wikimedia.org/r/319347

gerritbot added a comment.Nov 3 2016, 7:40 AM

Change 319351 merged by Ema:
cache_text: upgrade codfw to Varnish 4

https://gerrit.wikimedia.org/r/319351

Stashbot subscribed.Nov 3 2016, 7:42 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T07:42:10Z] <ema> upgrading cp2023 (text-codfw) to varnish 4 -- T131503

Stashbot added a comment.Nov 3 2016, 8:01 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T08:01:21Z] <ema> upgrading cp2019 (text-codfw) to varnish 4 -- T131503

Stashbot added a comment.Nov 3 2016, 8:47 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T08:47:57Z] <ema> upgrading cp2007 (text-codfw) to varnish 4 -- T131503

Stashbot added a comment.Nov 3 2016, 9:24 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T09:24:06Z] <ema> upgrading cp2016 (text-codfw) to varnish 4 -- T131503

Stashbot added a comment.Nov 3 2016, 11:16 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T11:16:40Z] <ema> depooling cp2016, cp2007, cp2019, cp2023: not caching properly (T131503)

gerritbot added a comment.Nov 3 2016, 1:07 PM

Change 319561 had a related patch set uploaded (by BBlack):
Text VCL: Fix cookie handling for Varnish4

https://gerrit.wikimedia.org/r/319561

gerritbot added a comment.Nov 3 2016, 4:40 PM

Change 319609 had a related patch set uploaded (by Ema):
cache_text: switch to file storage backend on Varnish 4

https://gerrit.wikimedia.org/r/319609

gerritbot added a comment.Nov 3 2016, 5:36 PM

Change 319561 merged by BBlack:
Text VCL: Fix cookie handling for Varnish4

https://gerrit.wikimedia.org/r/319561

gerritbot added a comment.Nov 3 2016, 5:52 PM

Change 319626 had a related patch set uploaded (by BBlack):
cache_text: use file storage

https://gerrit.wikimedia.org/r/319626

gerritbot added a comment.Nov 3 2016, 6:06 PM

Change 319626 abandoned by BBlack:
cache_text: use file storage

https://gerrit.wikimedia.org/r/319626

gerritbot added a comment.Nov 3 2016, 6:15 PM

Change 319609 merged by BBlack:
cache_text: switch to file storage backend on Varnish 4

https://gerrit.wikimedia.org/r/319609

Stashbot added a comment.Nov 3 2016, 6:26 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T18:26:45Z] <ema> repooling cp2016 (T131503)

Stashbot added a comment.Nov 3 2016, 8:10 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T20:10:16Z] <bblack> codfw cache_text - all pooled nodes are v4 (2x still depooled-but-upgraded) - T131503

Stashbot added a comment.Nov 3 2016, 8:26 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-03T20:26:27Z] <bblack> codfw cache_text - all nodes v4 and pooled - T131503

gerritbot added a comment.Nov 4 2016, 11:15 AM

Change 319823 had a related patch set uploaded (by Ema):
cache_text: route ulsfo to codfw

https://gerrit.wikimedia.org/r/319823

gerritbot added a comment.Nov 4 2016, 11:16 AM

Change 319824 had a related patch set uploaded (by Ema):
cache_text: upgrade ulsfo to Varnish 4

https://gerrit.wikimedia.org/r/319824

gerritbot added a comment.Nov 4 2016, 11:53 AM

Change 319829 had a related patch set uploaded (by Ema):
cache_text varnishtest: proper caching of mangled URLs

https://gerrit.wikimedia.org/r/319829

gerritbot added a comment.Nov 4 2016, 1:39 PM

Change 319829 merged by Ema:
cache_text varnishtest: proper caching of mangled requests

https://gerrit.wikimedia.org/r/319829

gerritbot added a comment.Nov 4 2016, 1:41 PM

Change 319823 merged by Ema:
cache_text: route ulsfo to codfw

https://gerrit.wikimedia.org/r/319823

gerritbot added a comment.Nov 4 2016, 1:57 PM

Change 319824 merged by Ema:
cache_text: upgrade ulsfo to Varnish 4

https://gerrit.wikimedia.org/r/319824

Stashbot added a comment.Nov 4 2016, 2:14 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-04T14:14:26Z] <ema> upgrading cp4008 (text-ulsfo) to varnish 4 -- T131503

Stashbot added a comment.Nov 4 2016, 2:49 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-04T14:49:41Z] <ema> upgrading cp4009 (text-ulsfo) to varnish 4 -- T131503

Stashbot added a comment.Nov 4 2016, 3:37 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-04T15:37:16Z] <ema> upgrading cp4010 (text-ulsfo) to varnish 4 -- T131503

Stashbot added a comment.Nov 4 2016, 4:01 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-04T16:00:59Z] <ema> upgrading cp4016 (text-ulsfo) to varnish 4 -- T131503

Stashbot added a comment.Nov 4 2016, 4:22 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-04T16:22:46Z] <ema> upgrading cp4017 (text-ulsfo) to varnish 4 -- T131503

Stashbot added a comment.Nov 4 2016, 4:38 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-04T16:38:30Z] <ema> upgrading cp4018 (text-ulsfo) to varnish 4 -- T131503

gerritbot added a comment.Nov 7 2016, 11:56 AM

Change 320180 had a related patch set uploaded (by Ema):
cache_text esams: route to codfw

https://gerrit.wikimedia.org/r/320180

gerritbot added a comment.Nov 7 2016, 11:57 AM

Change 320181 had a related patch set uploaded (by Ema):
cache_text: upgrade esams to Varnish 4

https://gerrit.wikimedia.org/r/320181

gerritbot added a comment.Nov 7 2016, 8:05 PM

Change 320258 had a related patch set uploaded (by BBlack):
VCL: add backend_response_early hooks

https://gerrit.wikimedia.org/r/320258

gerritbot added a comment.Nov 7 2016, 8:05 PM

Change 320259 had a related patch set uploaded (by BBlack):
Text VCL: fixup beresp.Cookie for Vary before hfp

https://gerrit.wikimedia.org/r/320259

gerritbot added a comment.Nov 7 2016, 8:05 PM

Change 320260 had a related patch set uploaded (by BBlack):
Text VCL: avoid creating empty Cookie header

https://gerrit.wikimedia.org/r/320260

gerritbot added a comment.Nov 7 2016, 8:16 PM

Change 320258 merged by BBlack:
VCL: add backend_response_early hooks

https://gerrit.wikimedia.org/r/320258

gerritbot added a comment.Nov 7 2016, 8:17 PM

Change 320259 merged by BBlack:
Text VCL: fixup beresp.Cookie for Vary before hfp

https://gerrit.wikimedia.org/r/320259

gerritbot added a comment.Nov 7 2016, 8:17 PM

Change 320260 merged by BBlack:
Text VCL: avoid creating empty Cookie header

https://gerrit.wikimedia.org/r/320260

• Gilles mentioned this in T149873: CentralNotice: Review and update Varnish caching for Special:BannerLoader.Nov 8 2016, 2:07 PM
gerritbot added a comment.Nov 9 2016, 1:22 PM

Change 320180 merged by Ema:
cache_text esams: route to codfw

https://gerrit.wikimedia.org/r/320180

gerritbot added a comment.Nov 9 2016, 2:08 PM

Change 320181 merged by Ema:
cache_text: upgrade esams to Varnish 4

https://gerrit.wikimedia.org/r/320181

Stashbot added a comment.Nov 9 2016, 2:11 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T14:11:15Z] <ema> upgrading cp3030 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 2:32 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T14:32:22Z] <ema> upgrading cp3031 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 2:58 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T14:58:51Z] <ema> upgrading cp3032 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 3:11 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T15:11:15Z] <ema> upgrading cp3033 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 3:23 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T15:23:16Z] <ema> upgrading cp3040 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 3:34 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T15:34:11Z] <ema> upgrading cp3041 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 3:58 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T15:58:22Z] <ema> upgrading cp3042 (text-esams) to varnish 4 -- T131503

Stashbot added a comment.Nov 9 2016, 4:18 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-09T16:18:05Z] <ema> upgrading cp3043 (text-esams) to varnish 4 -- T131503

gerritbot added a comment.Nov 10 2016, 9:43 AM

Change 320745 had a related patch set uploaded (by Ema):
cache_text: upgrade eqiad to Varnish 4

https://gerrit.wikimedia.org/r/320745

gerritbot added a comment.Nov 10 2016, 9:52 AM

Change 320745 merged by Ema:
cache_text: upgrade eqiad to Varnish 4

https://gerrit.wikimedia.org/r/320745

Stashbot added a comment.Nov 10 2016, 9:53 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T09:53:45Z] <ema> upgrading cp1053 (text-eqiad) to varnish 4 -- T131503

Stashbot added a comment.Nov 10 2016, 10:29 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T10:29:14Z] <ema> upgrading cp1054 (text-eqiad) to varnish 4 -- T131503

Stashbot added a comment.Nov 10 2016, 10:43 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T10:43:30Z] <ema> upgrading cp1055 (text-eqiad) to varnish 4 -- T131503

Stashbot added a comment.Nov 10 2016, 11:08 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T11:08:19Z] <ema> upgrading cp1065 (text-eqiad) to varnish 4 -- T131503

Stashbot added a comment.Nov 10 2016, 11:25 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T11:25:58Z] <ema> upgrading cp1066 (text-eqiad) to varnish 4 -- T131503

Stashbot added a comment.Nov 10 2016, 11:45 AM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T11:45:53Z] <ema> upgrading cp1067 (text-eqiad) to varnish 4 -- T131503

Stashbot added a comment.Nov 10 2016, 12:01 PM

Mentioned in SAL (#wikimedia-operations) [2016-11-10T12:01:53Z] <ema> upgrading cp1068 (text-eqiad) to varnish 4 -- T131503

gerritbot added a comment.Nov 10 2016, 1:32 PM

Change 320774 had a related patch set uploaded (by Ema):
cache_text: route codfw back to eqiad

https://gerrit.wikimedia.org/r/320774

gerritbot added a comment.Nov 10 2016, 1:38 PM

Change 320774 merged by Ema:
cache_text: route codfw back to eqiad

https://gerrit.wikimedia.org/r/320774

gerritbot added a comment.Nov 10 2016, 1:42 PM

Change 320778 had a related patch set uploaded (by Ema):
cache_text: route esams back to eqiad

https://gerrit.wikimedia.org/r/320778

gerritbot added a comment.Nov 10 2016, 2:19 PM

Change 320778 merged by Ema:
cache_text: route esams back to eqiad

https://gerrit.wikimedia.org/r/320778

• ema closed this task as Resolved.Nov 24 2016, 3:06 PM
• ema claimed this task.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL