Page MenuHomePhabricator

Phase out nutcracker from mediawiki servers
Closed, ResolvedPublic

Description

With T212129 done, we have no use for nutcracker running on our app servers, thus, it is high time we removed it.

Nutcracker is currently not maintained (has something like 6 commits over the last 4 years, all merging external pull requests) and is currently used only to proxy connections to the redises running on the memcached hosts.

I would like to simplify our stack by removing nutcracker from the path to redis. To substitute for it, we can:
1 - Use the sharding/failover functionality baked into RedisBagOfStuff, at the cost of slightly worse performance because we would do hash routing in PHP. The risk I see is that we'd have to enable persistent connections in php-redis
2 - Use envoy also to proxy to redis - the redis support in envoy is pretty advanced at this point and includes the ability to mirror writes, which is interesting to us. See https://www.envoyproxy.io/docs/envoy/v1.16.0/intro/arch_overview/other_protocols/redis.html. The only risk here is that some quirks in envoy's proxying cause problems.~~

Event Timeline

Joe triaged this task as Medium priority.Mar 11 2021, 3:27 PM
jijiki renamed this task from Get rid of nutcracker for connecting to redis to Phase out nutcracker for connecting to redis.Apr 19 2021, 7:09 PM

Change 824734 had a related patch set uploaded (by Krinkle; author: Krinkle):

[operations/mediawiki-config@master] redis: Remove references to nutcracker and redis_sessions cluster

https://gerrit.wikimedia.org/r/824734

Change 824734 merged by jenkins-bot:

[operations/mediawiki-config@master] redis: Remove references to nutcracker and redis_sessions cluster

https://gerrit.wikimedia.org/r/824734

jijiki renamed this task from Phase out nutcracker for connecting to redis to Phase out nutcracker from mediawiki servers.Sep 28 2022, 4:40 PM
jijiki updated the task description. (Show Details)

Change 861806 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] mediawiki: remove nutcracker from application servers

https://gerrit.wikimedia.org/r/861806

Change 861807 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] Remove nutcracker from cloudweb hosts

https://gerrit.wikimedia.org/r/861807

Change 861806 merged by Effie Mouzeli:

[operations/puppet@production] mediawiki: Goodbye Nutcracker

https://gerrit.wikimedia.org/r/861806

Mentioned in SAL (#wikimedia-operations) [2022-12-15T09:54:03Z] <effie> stopping and masking nutcracker on mw servers - T277183

This work is done