Make sure gridengine-exec starts on boot
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	valhallasw
	Aug 20 2015, 4:40 PM

Description

gridengine-exec does not always start after a reboot. This means queues stay unavailable until someone does this manually.

more info @ {T109412: Enable tools-webgrid-lighttpd-1411.tools.eqiad.wmflabs and build more webgrid hosts}
and
https://wikitech.wikimedia.org/wiki/Incident_documentation/20150817-ToolLabs-WebgridOutage

Details

	Subject	Repo	Branch	Lines +/-
	gridengine: Ensure that service gridengine-exec is running	operations/puppet	production	+7 -1

Customize query in gerrit

Related Objects

Mentioned In: T110532: puppet gridengine-exec start always triggered
rOPUPcc28fbf8fb64: gridengine: Ensure that service gridengine-exec is running
Mentioned Here: T109412: Enable tools-webgrid-lighttpd-1411.tools.eqiad.wmflabs and build more webgrid hosts

Event Timeline

valhallasw created this task.Aug 20 2015, 4:40 PM

valhallasw raised the priority of this task from to Needs Triage.

valhallasw updated the task description. (Show Details)

valhallasw added a project: Toolforge.

valhallasw subscribed.

Restricted Application added a project: Cloud-Services. · View Herald TranscriptAug 20 2015, 4:40 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

I guess we should put in a service {} stanza.

Sounds like a good way to make sure it stays online, but I'm not sure if we should rely on just puppet for starting services (after all, it might take ~20 mins). On the other hand, we have good puppet monitoring (and no init.d/upstart monitoring), so we might as well rely on it.

Change 233087 had a related patch set uploaded (by Tim Landscheidt):
gridengine: Ensure that service gridengine-exec is running

https://gerrit.wikimedia.org/r/233087

gerritbot added a project: Patch-For-Review.Aug 22 2015, 2:29 AM

scfc claimed this task.Aug 22 2015, 2:32 AM

scfc moved this task from Backlog to Waiting for code review on the Toolforge board.

Change 233087 merged by Yuvipanda:
gridengine: Ensure that service gridengine-exec is running

https://gerrit.wikimedia.org/r/233087

yuvipanda mentioned this in rOPUPcc28fbf8fb64: gridengine: Ensure that service gridengine-exec is running.Aug 22 2015, 9:13 PM

valhallasw closed this task as Resolved.Aug 22 2015, 9:14 PM

valhallasw mentioned this in T110532: puppet gridengine-exec start always triggered.Aug 27 2015, 3:05 PM

• Phabricator_maintenance removed a subscriber: yuvipanda.Jun 7 2017, 6:47 PM