Page MenuHomePhabricator

Fix static asset varnish cache invalidation issues
Closed, InvalidPublic

Description

Currently, when static assets are deployed via scap out-of-sync with mediawiki version bumps, there's no mechanism to invalidate previously-cached copies of the old data that lived at that URL. What saves us in the most common case is that most of those assets are loaded by ResourceLoader rather than directly by the client, but this isn't true for all such paths (such as certain icons/images, some of which have cache-busting workarounds now like ?date query args), and it's not true for ResourceLoader under debug=true, either.

What we need here is a mechanism for scaps which change such files mid-version to send HTCP invalidations for these paths to the cache clusters, and there are various implementation details to sort out there. Probably the key one to solve up front is to research what the HTCP request should look like to ban a /static/ path across all hostnames, given the custom vcl_hash stuff that caches them centrally for all hostnames. That may require some VCL implementation on our end as well.

While this problem has always been present, the recent migration of these URLs from the bits cluster to the text cluster has magnified its visibility, because the old bits clusters had a small enough cache that they would eventually lose track of outdated files organically much faster than the text clusters do.

Event Timeline

BBlack created this task.May 14 2015, 5:10 PM
BBlack raised the priority of this task from to Needs Triage.
BBlack updated the task description. (Show Details)
BBlack added a subscriber: BBlack.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 14 2015, 5:10 PM
BBlack set Security to None.May 14 2015, 5:11 PM
BBlack added subscribers: bd808, Anomie, AndyRussG.
BBlack updated the task description. (Show Details)May 14 2015, 5:22 PM
BBlack changed the task status from Duplicate to Invalid.May 14 2015, 5:30 PM
BBlack claimed this task.

Duplicate of T99096

BBlack moved this task from Triage to Done on the Traffic board.May 20 2015, 7:50 AM