Sort query parameters on urls
Closed, DuplicatePublic
Actions

Assigned To

None

Authored By

	• Jhernandez
	Aug 22 2016, 5:15 PM

Description

Would it be possible to sort the query parameters on urls so that urls with params on different order would result to the same cache hits?

Varnish 3: https://old.varnish-cache.org/vmod/boltsort-querystring-params-sort
- Varnish 4: Varnish 4.0 now has query sorting built in through the std VMOD.

That way:

/video/48088296?title=0&byline=0&portrait=0&color=51a516
/video/48088296?byline=0&color=51a516&portrait=0&title=0

Would resolve to the same value.

Event Timeline

• Jhernandez created this task.Aug 22 2016, 5:15 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptAug 22 2016, 5:15 PM

• Jhernandez edited projects, added Traffic; removed Varnish.Aug 22 2016, 5:16 PM

Restricted Application added a project: SRE. · View Herald TranscriptAug 22 2016, 5:16 PM

I'm out of my depths here, so sorry if it is a stupid question. I'm interested to understand why we're not doing this already.

The why is that there's an interest in sending more traffic to mediawiki apis from readers page views with things like related articles at the bottom of the article. Having to care about query param order when querying the api with smaxage can end up splitting the cache without noticing, so having consistent urls with query string sorting on the edge cache would make the clients more resilient and maybe reduce some caching duplicates.

I don't think this is an issue that we've noticed right now though.

I've cc'ed @dr0ptp4kt and @phuedx which were interested in the discussion too.

BBlack closed this task as a duplicate of T138093: Investigate query parameter normalization for MW/services.Aug 22 2016, 7:44 PM

Sort query parameters on urlsClosed, DuplicatePublicActions

Description

Event Timeline

Sort query parameters on urls
Closed, DuplicatePublic
Actions