Page MenuHomePhabricator
Create Task
Maniphest T122880

Evaluate and Test Limited Deployment of Varnish 4
Closed, ResolvedPublic
Actions

Description

This is a (stretch?) goal for Q3 of FY15-16

Key results:

  • Evaluate basics of Varnish 3.x -> 4.x migration for existing functionality
  • Convert at least one cache cluster to Varnish 4.x (probably cache_misc for simplicity)

ETA: EOQ

Dependencies: Ongoing varnish refactoring

Rationale:

  • Reduce tech debt of running our legacy modified Varnish 3.x which is outdated
  • Remove blockers for progress on further edge-layer refactoring and improvements
  • Intended to prepare for a follow-on next-quarter goal to convert all other clusters

Details

Related Changes in Gerrit:
Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

BBlack created this task.Jan 5 2016, 2:23 PM
BBlack raised the priority of this task from to Needs Triage.
BBlack updated the task description. (Show Details)
BBlack added a project: Traffic.
BBlack added subscribers: BBlack, mark, faidon.
Restricted Application added a project: SRE. · View Herald TranscriptJan 5 2016, 2:23 PM
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript
BBlack added a parent task: T122881: Install XKey vmod.Jan 5 2016, 2:26 PM
BBlack added a parent task: T122867: Evaluate the feasibility of cache invalidation for the action API.
Southparkfan subscribed.Jan 12 2016, 3:08 PM
BBlack added a subscriber: • ema.Jan 13 2016, 5:22 PM
• ema claimed this task.Jan 21 2016, 10:50 AM
• ema set Security to None.
• ema closed subtask T124277: Forward-port Varnish 3 patches to Varnish 4 as Resolved.Jan 29 2016, 2:50 PM
gerritbot subscribed.Feb 5 2016, 9:47 AM

Change 268633 had a related patch set uploaded (by Ema):
debian/rules: pass --no-start to varnish{log,ncsa}

https://gerrit.wikimedia.org/r/268633

gerritbot added a project: Patch-For-Review.Feb 5 2016, 9:47 AM
gerritbot added a comment.Feb 5 2016, 9:51 AM

Change 268633 merged by Ema:
debian/rules: pass --no-start to varnish{log,ncsa}

https://gerrit.wikimedia.org/r/268633

• matmarex reopened subtask T126206: Upgrade to Varnish 4: things to remember as Open.Feb 8 2016, 6:32 PM
gerritbot added a comment.Feb 10 2016, 12:26 PM

Change 269664 had a related patch set uploaded (by Ema):
Port Varnish systemd unit file to Varnish 4

https://gerrit.wikimedia.org/r/269664

gerritbot added a comment.Feb 10 2016, 1:31 PM

Change 269664 merged by Ema:
Port Varnish systemd unit file to Varnish 4

https://gerrit.wikimedia.org/r/269664

• GWicke added a parent task: T114662: RFC: Per-language URLs for multilingual wiki pages.Feb 10 2016, 10:42 PM
• ema triaged this task as Medium priority.Feb 23 2016, 9:30 AM
hashar created subtask T128188: Make CI run Varnish VCL tests.Feb 26 2016, 2:32 PM
ori added a subtask: T128788: Port varnishlog.py to new VSL API.Mar 3 2016, 8:51 PM
gerritbot added a comment.Mar 24 2016, 7:37 PM

Change 279432 had a related patch set uploaded (by Ema):
apt_preferences for v3/v4 varnish packages

https://gerrit.wikimedia.org/r/279432

gerritbot added a comment.Mar 24 2016, 9:19 PM

Change 279432 merged by Ema:
apt_preferences for v3/v4 varnish packages

https://gerrit.wikimedia.org/r/279432

gerritbot added a comment.Mar 25 2016, 10:23 AM

Change 279592 had a related patch set uploaded (by Ema):
Package new upstream release: 4.1.2-1

https://gerrit.wikimedia.org/r/279592

gerritbot added a comment.Mar 25 2016, 10:25 AM

Change 279592 merged by Ema:
Package new upstream release: 4.1.2-1

https://gerrit.wikimedia.org/r/279592

gerritbot added a comment.Mar 29 2016, 9:10 AM

Change 280162 had a related patch set uploaded (by Ema):
APT pinning for varnishkafka

https://gerrit.wikimedia.org/r/280162

gerritbot added a comment.Mar 29 2016, 9:16 AM

Change 280163 had a related patch set uploaded (by Ema):
Varnishkafka APT pinning moved to submodule

https://gerrit.wikimedia.org/r/280163

gerritbot added a comment.Mar 29 2016, 10:18 AM

Change 280162 abandoned by Ema:
APT pinning for varnishkafka

Reason:
As elukey pointed out, this should not be done in the submodule but rather in the role, being a WMF-specific change. See https://gerrit.wikimedia.org/r/#/c/280163/

https://gerrit.wikimedia.org/r/280162

gerritbot added a comment.Mar 29 2016, 1:53 PM

Change 280163 merged by Ema:
Move Varnishkafka APT pinning to role definition

https://gerrit.wikimedia.org/r/280163

• ema moved this task from Backlog to Actively Servicing on the Traffic board.Mar 29 2016, 4:28 PM
gerritbot added a comment.Mar 30 2016, 8:33 AM

Change 280393 had a related patch set uploaded (by Ema):
Use Varnish 4 on cp1043

https://gerrit.wikimedia.org/r/280393

Stashbot subscribed.Mar 30 2016, 9:07 AM

Mentioned in SAL [2016-03-30T09:07:40Z] <ema> depooling cp1043 for varnish4 upgrade (T122880)

gerritbot added a comment.Mar 30 2016, 9:11 AM

Change 280393 merged by Ema:
Use Varnish 4 on cp1043

https://gerrit.wikimedia.org/r/280393

gerritbot added a comment.Mar 30 2016, 10:57 AM

Change 280412 had a related patch set uploaded (by Ema):
ganglia-varnish.py: use double quotes in metric description

https://gerrit.wikimedia.org/r/280412

gerritbot added a comment.Mar 30 2016, 10:59 AM

Change 280412 merged by Ema:
ganglia-varnish.py: use double quotes in metric description

https://gerrit.wikimedia.org/r/280412

Stashbot added a comment.Mar 30 2016, 12:40 PM

Mentioned in SAL [2016-03-30T12:40:53Z] <ema> repooling cp1043 running varnish4 (T122880)

gerritbot added a comment.Mar 31 2016, 11:03 AM

Change 280646 had a related patch set uploaded (by Ema):
ganglia-varnish.py: get rid of dangerous characters

https://gerrit.wikimedia.org/r/280646

gerritbot added a comment.Mar 31 2016, 11:19 AM

Change 280646 merged by Ema:
ganglia-varnish.py: get rid of dangerous characters

https://gerrit.wikimedia.org/r/280646

gerritbot added a comment.Mar 31 2016, 12:54 PM

Change 280660 had a related patch set uploaded (by Ema):
Upgrade cp1044 to Varnish 4

https://gerrit.wikimedia.org/r/280660

Stashbot added a comment.Mar 31 2016, 1:09 PM

Mentioned in SAL [2016-03-31T13:09:38Z] <ema> depooling cp1044 for varnish 4 upgrade (T122880)

gerritbot added a comment.Mar 31 2016, 1:16 PM

Change 280660 merged by Ema:
Upgrade cp1044 to Varnish 4

https://gerrit.wikimedia.org/r/280660

Stashbot added a comment.Mar 31 2016, 1:27 PM

Mentioned in SAL [2016-03-31T13:27:14Z] <ema> repooling cp1044, upgraded to varnish 4 (T122880)

• ema closed subtask T124281: Create separate packages for required vmods as Resolved.Mar 31 2016, 1:39 PM
• ema closed subtask T124279: Forward-port maps VCL to Varnish 4 as Resolved.Mar 31 2016, 1:45 PM
• ema closed subtask T128788: Port varnishlog.py to new VSL API as Resolved.Mar 31 2016, 1:51 PM
• ema removed a subtask: T128188: Make CI run Varnish VCL tests.Mar 31 2016, 1:53 PM
• ema moved this task from Actively Servicing to Done on the Traffic board.Apr 1 2016, 12:25 PM
• ema added a project: Varnish.Apr 1 2016, 1:33 PM
• ema removed a subtask: T126206: Upgrade to Varnish 4: things to remember.Apr 1 2016, 1:58 PM
• ema removed a parent task: T122867: Evaluate the feasibility of cache invalidation for the action API.Apr 1 2016, 2:05 PM
• ema removed a parent task: T122881: Install XKey vmod.
• ema removed a parent task: T114662: RFC: Per-language URLs for multilingual wiki pages.
elukey closed subtask T124278: varnishkafka integration with Varnish 4 for analytics as Resolved.Apr 4 2016, 10:48 AM
• ema closed this task as Resolved.Apr 4 2016, 12:59 PM
gerritbot added a comment.Apr 25 2016, 9:10 PM

Change 285282 had a related patch set uploaded (by BBlack):
cache_maps: whole cluster to varnish4

https://gerrit.wikimedia.org/r/285282

gerritbot added a comment.Apr 25 2016, 9:18 PM

Change 285282 merged by BBlack:
cache_maps: whole cluster to varnish4

https://gerrit.wikimedia.org/r/285282

• MZMcBride subscribed.May 9 2016, 2:28 PM
gerritbot added a comment.Jul 31 2016, 8:21 AM

Change 302074 had a related patch set uploaded (by Ema):
cache_maps: remove varnish3 VCL compat

https://gerrit.wikimedia.org/r/302074

• ema mentioned this in rOPUP8b3c279cc4a7: cache_maps: remove varnish3 VCL compat.Jul 31 2016, 8:26 AM
• ema mentioned this in rOPUPd3313c2fb93e: cache_maps: remove varnish3 VCL compat.Aug 1 2016, 8:30 AM
gerritbot added a comment.Aug 1 2016, 8:31 AM

Change 302074 merged by Ema:
cache_maps: remove varnish3 VCL compat

https://gerrit.wikimedia.org/r/302074

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits