Page MenuHomePhabricator

Make WDQS throttling more aggressive
Closed, ResolvedPublic

Description

A recent incident on WDQS show that our throttling is not aggressive enough. The current throttling starts tracking users only once they make a request which takes more than 10 seconds to complete. This does not prevent a single user from generating enough short request to overload the system. We should reduce this threshold (or even remove it entirely), without changing the current limits.

For the record, the current limits are:

  • 60 seconds of processing time per minute (peak at 120 seconds)
  • 30 errors per minute (peak at 60)

Related Objects

StatusSubtypeAssignedTask
ResolvedGehel

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change 384986 had a related patch set uploaded (by Gehel; owner: Gehel):
[wikidata/query/rdf@master] Make throttling more aggressive

https://gerrit.wikimedia.org/r/384986

debt triaged this task as High priority.Oct 18 2017, 4:24 PM
debt added a parent task: Restricted Task.Oct 18 2017, 4:37 PM

Change 385348 had a related patch set uploaded (by Gehel; owner: Gehel):
[wikidata/query/rdf@master] Publish minimal metrics about throttling filter.

https://gerrit.wikimedia.org/r/385348

Change 385348 merged by jenkins-bot:
[wikidata/query/rdf@master] Publish minimal metrics about throttling filter.

https://gerrit.wikimedia.org/r/385348

Change 384986 merged by jenkins-bot:
[wikidata/query/rdf@master] Make throttling more aggressive

https://gerrit.wikimedia.org/r/384986