Page MenuHomePhabricator

Provision more job runners - stalled until migrated to HHVM
Closed, DeclinedPublic

Description

It would be nice to have a few more job runners, given their amount of CPU
usage. See Gabriel's comment on https://gerrit.wikimedia.org/r/#/c/161473/ for
details.
Maybe 2-4 more runners would be enough (currently there are ~16). I suspect
that the HHVM migration will help us out here as well. I don't see a reason why
similar specs won't suffice.

Details

Reference
rt8872

Event Timeline

rtimport raised the priority of this task from to Normal.Dec 18 2014, 2:18 AM
rtimport set Reference to rt8872.
aaron created this task.Nov 14 2014, 7:40 PM
Joe added a comment.Dec 15 2014, 8:14 AM

On Fri Nov 14 19:40:49 2014, aschulz wrote:

It would be nice to have a few more job runners, given their amount of
CPU
usage. See Gabriel's comment on
https://gerrit.wikimedia.org/r/#/c/161473/ for
details.
Maybe 2-4 more runners would be enough (currently there are ~16). I
suspect
that the HHVM migration will help us out here as well. I don't see a
reason why
similar specs won't suffice.

I think we're going to migrate some jobrunners to HHVM this week, so I'd
postpone the problem of provisioning more JRs to after the migration is
underway and we have a good idea of how it will perform. New => stalled

Status changed from 'new' to 'open' by RT_System

Joe added a comment.Dec 15 2014, 8:15 AM

Status changed from 'open' to 'stalled' by glavagetto

Joe added a comment.Dec 15 2014, 8:15 AM

Issue taken by glavagetto

Joe added a comment.Dec 15 2014, 8:15 AM

Subject changed from 'Provision more job runners' to 'Provision more job runners - stalled until migrated to HHVM' by glavagetto

Joe added a comment.Dec 22 2014, 7:16 AM

I think we would never need this - the currently running hhvm jobrunner(s) outperform the zend ones by leaps and bounds. Downgrading the priority on this for now but I'd probably decline it in the future.

Joe lowered the priority of this task from Normal to Low.Dec 22 2014, 7:16 AM
Joe changed the visibility from "WMF-NDA (Project)" to "Public (No Login Required)".
Joe changed the edit policy from "WMF-NDA (Project)" to "All Users".
Joe set Security to None.

Average utilization on the jobrunners cluster is low enough that I don't see a reason for this. Resolving as declined.

Joe closed this task as Declined.Jan 13 2015, 3:12 PM