- 429ing when a broken thumbnail is requested more than 4 times in 5 minutes (uses a DC-local cache)
- Use PoolCounter for throttling normal and expensive thumbnails
- Implement rate limiter to avoid a given IP DDOSing us with unique uncached requests
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | • Gilles | T121388 Service-based thumbnailing re-architecture in production with Thumbor | |||
| Resolved | • Gilles | T139606 add thumbor to production infrastructure | |||
| Resolved | • Gilles | T150641 Investigate differences in status codes between thumbor and image scalers | |||
| Resolved | • Gilles | T150745 Reimplement various rate-limiting mechanisms in Thumbor |
Event Timeline
Comment Actions
I think it'd make sense to have similar rate-limit capabilities to avoid overload. Implementation-wise I'm not sure though, is pool counter reserved for mediawiki usage only?
Comment Actions
Thumbor can probably talk to PoolCounter.
As for the failure counter, it's based on a cache, a DC-local memcache I presume. Thumbor could talk to that too.
Comment Actions
@Krinkle reminded me of the (presumably per-IP) rate limiter for uncached thumbnails. I need to figure out at what level that's implemented.