Page MenuHomePhabricator

Add all redis and memcached backends to mw on k8s automatically
Closed, ResolvedPublic

Description

We should only need to define our nutcracker and mcrouter configuration for mediawiki on k8s from the same hiera data structure we use in puppet, and probably add the data to mediawiki::web::yaml_defs.

Event Timeline

Joe triaged this task as High priority.

Change 698829 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] mcrouter: add mcrouter pools to deployment servers

https://gerrit.wikimedia.org/r/698829

Change 698829 merged by Effie Mouzeli:

[operations/puppet@production] mcrouter: add mcrouter pools to deployment servers

https://gerrit.wikimedia.org/r/698829

Change 699150 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] nutcracker::yaml_defs: add nutcracker pools for kubernetes

https://gerrit.wikimedia.org/r/699150

Change 699150 merged by Effie Mouzeli:

[operations/puppet@production] nutcracker::yaml_defs: add nutcracker pools for kubernetes

https://gerrit.wikimedia.org/r/699150

[operations/puppet@production] mcrouter: add mcrouter pools to deployment servers
https://gerrit.wikimedia.org/r/698829

@jijiki , looks like that broke the Beta-Cluster-Infrastructure deployment servers:

The last Puppet run was at Wed Jun  9 08:44:07 UTC 2021 (3112 minutes ago).
Error: Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Method call, 'map' expects one of:
  (Hash hash, Callable[2, 2] block)
    rejected: parameter 'hash' expects a Hash value, got Undef
  (Hash hash, Callable[1, 1] block)
    rejected: parameter 'hash' expects a Hash value, got Undef
  (Iterable enumerable, Callable[2, 2] block)
    rejected: parameter 'enumerable' expects an Iterable value, got Undef
  (Iterable enumerable, Callable[1, 1] block)
    rejected: parameter 'enumerable' expects an Iterable value, got Undef (file: /etc/puppet/modules/mediawiki/manifests/mcrouter/yaml_defs.pp, line: 23, column: 47) on node deployment-deploy01.deployment-prep.eqiad.wmflabs

On:

deployment-deploy01.deployment-prep.eqiad1.wikimedia.cloud
deployment-deploy02.deployment-prep.eqiad1.wikimedia.cloud
deployment-deploy03.deployment-prep.eqiad1.wikimedia.cloud

I guess cause some hiera values are required?

Change 699432 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/deployment-charts@master] mwdebug: include nutcracker and mcrouter pools in values

https://gerrit.wikimedia.org/r/699432

Change 699908 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] hieradata: Use TLS codfw pool for memcached replication on canaries

https://gerrit.wikimedia.org/r/699908

Change 699908 merged by Effie Mouzeli:

[operations/puppet@production] hieradata: Use TLS codfw pool for memcached replication on canaries

https://gerrit.wikimedia.org/r/699908

Change 700861 had a related patch set uploaded (by Effie Mouzeli; author: Effie Mouzeli):

[operations/puppet@production] hieradata: Use TLS codfw pool for memcached replication on eqiad

https://gerrit.wikimedia.org/r/700861

@jijiki I think this task is resolved as well, correct?

Change 699432 abandoned by Effie Mouzeli:

[operations/deployment-charts@master] mwdebug: include nutcracker and mcrouter pools in values

Reason:

https://gerrit.wikimedia.org/r/699432