Install XKey vmod
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	BBlack
	Jan 5 2016, 2:26 PM

Description

https://github.com/varnish/libvmod-xkey

This allows us to do alternate hashes for purging (e.g. article ID keys or thumbnail keys based on the original, etc)

May require Varnish 4.1 specifically, as opposed to 4.0.

Details

	Project	Branch	Lines +/-	Subject
	operations/puppet	production	+6 -3	Install package varnish-modules on v4 hosts

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
		Restricted Task
Duplicate	None	T109331 Deleted files sometimes remain visible to non-privileged users if permanently linked
Duplicate	None	T133819 upload-lb.ulsfo.wikimedia.org still allow access to some deleted files
Duplicate	BBlack	T119038 Image cache issue when 'over-writing' an image on commons
Resolved	• ema	T133821 Make CDN purges reliable
Open	None	T122867 Evaluate the feasibility of cache invalidation for the action API
Resolved	• ema	T122881 Install XKey vmod
Resolved	• ema	T131499 Upgrade all cache clusters to Varnish 4
Resolved	• ema	T126206 Upgrade to Varnish 4: things to remember
Resolved	• ema	T128788 Port varnishlog.py to new VSL API
Resolved	• ema	T131353 Port remaining scripts depending on varnishlog.py to new VSL API
Resolved	• ema	T131501 Convert misc cluster to Varnish 4
Resolved	• ema	T134989 WDQS empty response - transfer clsoed with 15042 bytes remaining to read
Resolved	• ema	T131502 Convert upload cluster to Varnish 4
Resolved	BBlack	T131761 Solve large-object/stream/pass/chunked in upload cluster better
Resolved	• ema	T142076 Analyze Range requests on cache_upload frontend
Resolved	• ema	T142233 Varnish 4 stalls with two consecutive Range requests using HTTP persistent connections
Resolved	• ema	T131503 Convert text cluster to Varnish 4
Resolved	BBlack	T135696 Sort out vcl_deliver vs vcl_synth mess with v4 VCL
Resolved	• ema	T150660 Post Varnish 4 migration cleanup

Event Timeline

BBlack created this task.Jan 5 2016, 2:26 PM

BBlack raised the priority of this task from to Needs Triage.

BBlack updated the task description. (Show Details)

BBlack added projects: SRE, Traffic.

BBlack added a subscriber: BBlack.

Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald TranscriptJan 5 2016, 2:26 PM

BBlack added a subtask: T122880: Evaluate and Test Limited Deployment of Varnish 4.Jan 5 2016, 2:26 PM

BBlack added a parent task: T122867: Evaluate the feasibility of cache invalidation for the action API.

• ema claimed this task.Mar 2 2016, 9:58 AM

• ema triaged this task as Medium priority.

• ema set Security to None.

Smalyshev added a subscriber: Smalyshev.Mar 2 2016, 11:22 PM

Smalyshev mentioned this in T128667: Special:EntityData with flavor is cached but not purged properly.Mar 2 2016, 11:29 PM

hoo added a subscriber: hoo.Mar 3 2016, 1:03 AM

• ema added a project: Varnish.Apr 1 2016, 1:33 PM

• ema added a parent task: T131499: Upgrade all cache clusters to Varnish 4.Apr 1 2016, 1:58 PM

• ema removed a parent task: T131499: Upgrade all cache clusters to Varnish 4.Apr 1 2016, 2:03 PM

• ema edited subtasks, added: T131499: Upgrade all cache clusters to Varnish 4; removed: T122880: Evaluate and Test Limited Deployment of Varnish 4.Apr 1 2016, 2:05 PM

BBlack mentioned this in T133821: Make CDN purges reliable.Apr 28 2016, 12:08 AM

BBlack added a parent task: T133821: Make CDN purges reliable.

Southparkfan added a subscriber: Southparkfan.Apr 28 2016, 12:27 PM

• GWicke mentioned this in T102476: RFC: Requirements for change propagation.May 13 2016, 11:12 PM

JanZerebecki added a subscriber: JanZerebecki.Jun 30 2016, 3:47 PM

• Gilles added a subscriber: • Gilles.Jun 30 2016, 8:51 PM

• ema moved this task from Triage to In Progress on the Traffic board.Jul 8 2016, 9:51 AM

The XKey vmod is part of a collection of VMODs called varnish-modules, already packaged in Debian.

I've just added a versioned build-dep on varnish > 4 to make sure the package can be built on Jessie. It's now a matter of building the package on copper and testing it out.

varnish-module is now available for testing on apt.wikimedia.org (jessie-wikimedia/backports).

Wikitech page added: https://wikitech.wikimedia.org/wiki/XKey