Page MenuHomePhabricator

Reorganize mw2* servers across clusters
Closed, ResolvedPublic

Description

At the moment we have the following situation:

Jobrunners:

eqiad - 672 cores, 750 GB RAM, 25 hosts
codfw - 320 cores,  447 GB RAM,  12 hosts

Imagescalers:

eqiad  - 192 cores, 94 GB RAM, 8 hosts
codfw - 288 cores, 503 GB RAM, 8 hosts

Appservers:

eqiad - 3100 cores, 4 TB RAM, 110 hosts
codfw - 3800 cores, 5.2 TB RAM, 119 hosts

API:

eqiad - 2000 cores, 2.5 TB RAM, 70 hosts
codfw - 2200 cores, 3.2 TB RAM, 72 hosts
NOTE: codfw imagescalers might be more engaged after the switchoff than the corresponding hosts in eqiad

We need to rebalance some machines as the initial distribution was done according to the situation in eqiad almost a year ago.

Event Timeline

Joe raised the priority of this task from Medium to High.

Change 275389 had a related patch set uploaded (by Giuseppe Lavagetto):
mediawiki: convert mw2153-62 to be jobrunners

https://gerrit.wikimedia.org/r/275389

Change 275389 merged by Giuseppe Lavagetto:
mediawiki: convert mw2153-62 to be jobrunners

https://gerrit.wikimedia.org/r/275389

Change 275421 had a related patch set uploaded (by Giuseppe Lavagetto):
mediawiki: remove the newly-appointed jobrunners from conftool

https://gerrit.wikimedia.org/r/275421

Change 275421 merged by Giuseppe Lavagetto:
mediawiki: remove the newly-appointed jobrunners from conftool

https://gerrit.wikimedia.org/r/275421

Updated situation in codfw

jobrunners:

eqiad - 672 cores, 750 GB RAM, 25 hosts
codfw - 720 cores. 1.1 TB RAM, 22 hosts

appservers:

eqiad - 3100 cores, 4 TB RAM, 110 hosts
codfw - 3400 cores, 4.6 TB RAM,  109 hosts