Page MenuHomePhabricator

Investigate rate limiting of edits on WDQS
Open, Needs TriagePublic

Description

We've had 2 recent incidents where high edit rates on wikidata lead to overload of the public WDQS endpoint. We should at least investigate rate limiting the edits consumed by wdqs-updater to match what the different clusters are able to consume without too much impact on the read traffic. Note that this will cause increase update lag, but that's probably a better solution than a complete loss of service.

Event Timeline

Gehel created this task.Jun 24 2019, 3:24 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptJun 24 2019, 3:24 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Please be aware of T221774 which is currently being worked on and should help.

Yes, right now adding the query service lag to max lag seems like the first sensible step.