Page MenuHomePhabricator

Provision additional jobrunners
Closed, ResolvedPublic

Description

The general application server pool is over-provisioned, with average CPU utilization of about 8%. CPU utilization on the job runners is five times that, at 41%. Given that the two roles share the same hardware builds and a largely identical software stack, it should be possible to convert several application servers to be job runners, and thereby improve performance of the job queue, without hurting the performance or availability of the application server pool.

Event Timeline

ori created this task.Dec 15 2015, 6:11 PM
ori raised the priority of this task from to High.
ori updated the task description. (Show Details)
ori added projects: Operations, Performance-Team.
ori added subscribers: ori, Joe.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 15 2015, 6:11 PM

Change 259298 had a related patch set uploaded (by Ori.livneh):
Convert mw1161 to a job runner

https://gerrit.wikimedia.org/r/259298

Change 259298 merged by Ori.livneh:
Convert mw1161 to a job runner

https://gerrit.wikimedia.org/r/259298

ori added a comment.Dec 15 2015, 6:21 PM

Re-provisioning mw1161 went very smoothly. See attached Puppet log.

Change 259207 had a related patch set uploaded (by Ori.livneh):
Convert mw1162-1169 to job runners

https://gerrit.wikimedia.org/r/259207

Change 259207 merged by Ori.livneh:
Convert mw1162-1169 to job runners

https://gerrit.wikimedia.org/r/259207

Change 259306 had a related patch set uploaded (by Ori.livneh):
Follow-up for Ie5a79a8c17d: delist mw1162-1169 in conftool manifest, too

https://gerrit.wikimedia.org/r/259306

Change 259306 merged by Ori.livneh:
Follow-up for Ie5a79a8c17d: delist mw1162-1169 in conftool manifest, too

https://gerrit.wikimedia.org/r/259306

ori closed this task as Resolved.Dec 21 2015, 7:42 PM
ori claimed this task.