Page MenuHomePhabricator

Separate ChangeProp and JobQueue Redis
Open, NormalPublic

Description

Currently the ChangeProp instances used for RESTBase updates and for MediaWiki-JobQueue uses the same instances of Redis running on the rdb cluster on port 6382. We are not loading Redis a lot right now, the average mem usage is just about 500 megs, but if one of the services starts spamming Redis it could affect the other one.

It wouldn't be a big deal, because both services rely on Redis only for deduplication and rate limiting and will be operational if Redis is down, but in order to separate services even more I think we need dedicated instances for each service.

Event Timeline

Pchelolo triaged this task as Normal priority.Dec 22 2017, 7:07 PM
Pchelolo created this task.
Restricted Application added a project: Analytics. · View Herald TranscriptDec 22 2017, 7:07 PM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

+1. Given the way Redis is used in CP and CP4JQ, we might want to set these separate instances up in Kubernetes as early as Q4!

fdans moved this task from Incoming to Radar on the Analytics board.Jan 4 2018, 6:09 PM
jijiki added a subscriber: jijiki.Jun 13 2019, 8:25 AM