Wikimedia's User-Agent policy specifically forbids using generic values for the User-Agent request header.
Apply stricter rate limiting to requests violating the policy.
Description
Description
Event Timeline
Comment Actions
Change 514017 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] cache_upload: return HTTP 403 to requests violating UA policy
Comment Actions
Change 514017 merged by Ema:
[operations/puppet@production] cache_upload: return HTTP 403 to requests violating UA policy
Comment Actions
For Tech News: Bots and other scripts that do not set an identifiable User-Agent may find their requests blocked until they identify themselves properly.
Comment Actions
Not sure if it applies here, but please remember that we allow Api-User-Agent as an alternative to User-Agent for Javascript solutions.
Comment Actions
We (Traffic) have decided to continue allowing requests violating the UA policy. Instead of blocking them, we will apply stricter rate limiting to those.
Comment Actions
Change 513596 had a related patch set uploaded (by Ema; owner: Ema):
[operations/puppet@production] varnish: cache_upload rate limit
Comment Actions
Change 513596 merged by Ema:
[operations/puppet@production] varnish: cache_upload miss/pass rate limit
Comment Actions
TechNews: I've added it to the upcoming edition with this edit, that will be frozen for translation in about 18 hours. Please amend it before then if needed. (And thank you @Legoktm for writing the initial version!). Cheers!