Page MenuHomePhabricator

[WE5.4.8] Media rate limiting
Open, In Progress, HighPublic

Description

In order to have more fine-grained control on the network saturation between the edge and the swift backends for upload.wikimedia.org, implement a rate-limiting solution, partly based on the work already done for T399291: Epic: API Rate Limiting Architecture

The ratelimit will be enforced by the envoy instances fronting the ms-fe swift servers, backed by a standalone ratelimit service identical to the one used by the mesh for internal rate limiting.

As the goal is to limit the bandwidth used and that is not directly related to the number of requests, we will implement cost-based rate limiting T399844: Investigate feasibility of cost-based rate-limiting with Envoy using the response size as the cost function.

Event Timeline

Clement_Goubert changed the task status from Open to In Progress.Jan 13 2026, 11:29 AM
Clement_Goubert triaged this task as High priority.
Clement_Goubert moved this task from Inbox to In Progress on the ServiceOps new board.
Clement_Goubert renamed this task from upload.wikimedia.org rate limiting to [WE5.4.8] Media rate limiting.Jan 14 2026, 10:17 AM