Page MenuHomePhabricator
Create Task
Maniphest T188062

Remove imagescaler cluster (aka 'rendering')
Closed, ResolvedPublic
Actions

Description

This is a tracking task for the removal of the imagescaler cluster of MediaWiki app servers, as well as the LVS rendering service-IP load balancer.

TODO: (In no particular order)

  • Migrate users of image scalers:
  • Remove routing for image scalers:
    • Remove rendering director from Varnish.
    • Remove rendering handling from PyBall, LVS, and service IP.
    • Remove imagescaler-rw and imagescaler-ro from conftool/discovery.
    • Un-provision imagescaler hosts in Puppet (use spare role?)
    • Remove all code in Puppet relating to imagescaler roles and classes, including imagescaler_eqiad and imagescaler_codfw monitoring groups.
  • Decommission the hosts and/or reclaim as spare.

Details

Show related patches Customize query in gerrit

Related Objects
Search...

Event Timeline

Krinkle created this task.Feb 23 2018, 1:36 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 23 2018, 1:36 AM
Krinkle added a subtask: T187899: Stop routing Varnish thumb.php traffic to image scalers.Feb 23 2018, 1:36 AM
Krinkle updated the task description. (Show Details)Feb 23 2018, 1:43 AM
Krinkle updated the task description. (Show Details)
• brooke subscribed.Feb 24 2018, 8:10 AM

There has been a suggestion to recycle some of these as video scalers (T188075) if they're not needed elsewhere. Will have a sustained need for cpu capacity for a while to transition from VP8 to VP9 video transcodes, saving bandwidth and storage space.

• MoritzMuehlenhoff subscribed.Feb 26 2018, 11:20 AM
faidon mentioned this in T188075: eqiad/codfw: (4)+(4) hardware access request for videoscalers.Feb 26 2018, 2:47 PM
• MoritzMuehlenhoff claimed this task.Feb 26 2018, 3:21 PM
• MoritzMuehlenhoff triaged this task as Medium priority.
• Gilles closed subtask T187899: Stop routing Varnish thumb.php traffic to image scalers as Resolved.Apr 4 2018, 12:28 PM
gerritbot subscribed.Apr 6 2018, 10:38 AM

Change 424552 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove Varnish config for image scaler cluster

https://gerrit.wikimedia.org/r/424552

gerritbot added a project: Patch-For-Review.Apr 6 2018, 10:38 AM
gerritbot added a comment.Apr 6 2018, 10:50 AM

Change 424553 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove LVS/pybal config for image scaler cluster

https://gerrit.wikimedia.org/r/424553

gerritbot added a comment.Apr 6 2018, 2:06 PM

Change 424594 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove obsolete Hiera setting

https://gerrit.wikimedia.org/r/424594

Krinkle added a project: Performance-Team (Radar).Apr 10 2018, 2:55 PM
Krinkle moved this task from Limbo to Watching on the Performance-Team (Radar) board.
gerritbot added a comment.Apr 16 2018, 1:21 PM

Change 424594 merged by Filippo Giunchedi:
[operations/puppet@production] Remove obsolete imagescaler logic from swift proxy

https://gerrit.wikimedia.org/r/424594

Stashbot subscribed.Apr 16 2018, 1:30 PM

Mentioned in SAL (#wikimedia-operations) [2018-04-16T13:30:54Z] <godog> roll-restart swift-proxy in codfw and eqiad - T188062

gerritbot added a comment.Apr 17 2018, 9:59 AM

Change 424552 merged by Muehlenhoff:
[operations/puppet@production] Remove Varnish config for image scaler cluster

https://gerrit.wikimedia.org/r/424552

gerritbot added a comment.Apr 17 2018, 10:27 AM

Change 424553 merged by Muehlenhoff:
[operations/puppet@production] Remove LVS/pybal config for image scaler cluster

https://gerrit.wikimedia.org/r/424553

Stashbot added a comment.Apr 17 2018, 10:39 AM

Mentioned in SAL (#wikimedia-operations) [2018-04-17T10:39:34Z] <ema> lvs200[63]: restart pybal to apply https://gerrit.wikimedia.org/r/424553 T188062

Stashbot added a comment.Apr 17 2018, 10:52 AM

Mentioned in SAL (#wikimedia-operations) [2018-04-17T10:52:35Z] <ema> lvs100[63] restart pybal to apply https://gerrit.wikimedia.org/r/424553 T188062

gerritbot added a comment.Apr 17 2018, 11:13 AM

Change 427092 had a related patch set uploaded (by Ema; owner: Ema):
[operations/dns@master] Remove rendering

https://gerrit.wikimedia.org/r/427092

gerritbot added a comment.Apr 17 2018, 11:15 AM

Change 427093 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove discovery hiera settings for the image scalers

https://gerrit.wikimedia.org/r/427093

gerritbot added a comment.Apr 17 2018, 11:24 AM

Change 427092 merged by Ema:
[operations/dns@master] Remove imagescaler discovery entries / rendering records

https://gerrit.wikimedia.org/r/427092

gerritbot added a comment.Apr 17 2018, 11:45 AM

Change 425982 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove conftool configuration for image scalers.

https://gerrit.wikimedia.org/r/425982

gerritbot added a comment.Apr 17 2018, 11:52 AM

Change 427093 merged by Muehlenhoff:
[operations/puppet@production] Remove discovery hiera settings for the image scalers.

https://gerrit.wikimedia.org/r/427093

gerritbot added a comment.Apr 17 2018, 12:01 PM

Change 427096 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Switch former image scalers to role::spare

https://gerrit.wikimedia.org/r/427096

gerritbot added a comment.Apr 17 2018, 12:03 PM

Change 427097 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove Prometheus config for image scalers

https://gerrit.wikimedia.org/r/427097

gerritbot added a comment.Apr 17 2018, 1:20 PM

Change 427096 merged by Muehlenhoff:
[operations/puppet@production] Switch former image scalers to role::spare

https://gerrit.wikimedia.org/r/427096

gerritbot added a comment.Apr 17 2018, 2:21 PM

Change 425982 merged by Muehlenhoff:
[operations/puppet@production] Remove conftool configuration for image scalers.

https://gerrit.wikimedia.org/r/425982

gerritbot added a comment.Apr 17 2018, 2:35 PM

Change 427129 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove more hiera entries related to the new deprecated image scalers

https://gerrit.wikimedia.org/r/427129

gerritbot added a comment.Apr 17 2018, 2:39 PM

Change 427097 merged by Muehlenhoff:
[operations/puppet@production] Remove Prometheus config for image scalers

https://gerrit.wikimedia.org/r/427097

gerritbot added a comment.Apr 17 2018, 2:49 PM

Change 427133 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Remove image scaler Cumin aliases

https://gerrit.wikimedia.org/r/427133

gerritbot added a comment.Apr 17 2018, 3:11 PM

Change 427133 merged by Muehlenhoff:
[operations/puppet@production] Remove image scaler Cumin aliases

https://gerrit.wikimedia.org/r/427133

gerritbot added a comment.Apr 18 2018, 10:19 AM

Change 427129 merged by Muehlenhoff:
[operations/puppet@production] Remove more hiera entries related to the new deprecated image scalers

https://gerrit.wikimedia.org/r/427129

gerritbot added a comment.Apr 18 2018, 11:41 AM

Change 427361 had a related patch set uploaded (by Muehlenhoff; owner: Muehlenhoff):
[operations/puppet@production] Simplify threedtopng::deploy after image scaler removal

https://gerrit.wikimedia.org/r/427361

gerritbot added a comment.Apr 19 2018, 1:50 PM

Change 427361 merged by Muehlenhoff:
[operations/puppet@production] Simplify threedtopng::deploy after image scaler removal

https://gerrit.wikimedia.org/r/427361

• MoritzMuehlenhoff closed this task as Resolved.Apr 19 2018, 2:14 PM

All traces of the image scalers are gone. There's some additional puppet refactoring to be done, but unrelated to the removal of the image scalers.

Krinkle mentioned this in T56751: Thumbs from Special:VipsTest fail.Jul 18 2018, 7:07 PM
Krinkle mentioned this in T199937: Thumbs from VipsScaler fail (HTTP 500; 10.2.1.21 refuses port 80).
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits