Page MenuHomePhabricator

Investigate rate limiting of edits on WDQS
Closed, ResolvedPublic

Description

We've had 2 recent incidents where high edit rates on wikidata lead to overload of the public WDQS endpoint. We should at least investigate rate limiting the edits consumed by wdqs-updater to match what the different clusters are able to consume without too much impact on the read traffic. Note that this will cause increase update lag, but that's probably a better solution than a complete loss of service.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Please be aware of T221774 which is currently being worked on and should help.

Yes, right now adding the query service lag to max lag seems like the first sensible step.

Addshore claimed this task.

Going to mark this as resolved.
T221774 has been done and has a follow up of T238751