What already available software can we build on for a job scheduler?
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	ArielGlenn
	Mar 1 2016, 10:08 PM

Description

Instead of having a home grown pile of python scripts, what can we use as a building block for a job scheduler and manager?

Related Objects
Search...

Status	Assigned	Task
Declined	None	T146070 Review progress of dumps rewrite
Declined	None	T128513 Dumps 2.0 Platform design questions
Declined	None	T128520 What already available software can we build on for a job scheduler?
Declined	None	T143205 Draft usage scenarios for job/workflow manager
Declined	None	T143206 List requirements needed for task/job/workflow manager.
Declined	None	T143207 Evaluate software packages for job/task/workflow management

Event Timeline

ArielGlenn created this task.Mar 1 2016, 10:08 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 1 2016, 10:08 PM

ArielGlenn triaged this task as Medium priority.Mar 1 2016, 10:09 PM

ArielGlenn added a parent task: T128513: Dumps 2.0 Platform design questions.

ArielGlenn raised the priority of this task from Medium to High.Mar 7 2016, 6:10 PM

Time to get started on this. If done properly it can be used for production of the current dumps as well, allowing us to remove several levels of annoying abstraction from the existing code.

To do:

Draft several usage scenarios for task submission, status check requests and more
Set out requirements for task manager/job scheduler/workflow manager
Evaluate existing software
Choose one!

Guess I'll turn these into subtasks so we can start tossing notes into them.

ArielGlenn created subtask T143205: Draft usage scenarios for job/workflow manager.Aug 17 2016, 1:17 PM

ArielGlenn created subtask T143206: List requirements needed for task/job/workflow manager..Aug 17 2016, 1:21 PM

ArielGlenn claimed this task.Aug 17 2016, 1:24 PM

ArielGlenn created subtask T143207: Evaluate software packages for job/task/workflow management.

ArielGlenn moved this task from Backlog to active on the Dumps-Rewrite board.Apr 24 2017, 11:06 AM

ArielGlenn mentioned this in T237361: Discuss common needs in a job manager/scheduler.Nov 5 2019, 4:43 PM

This task has been assigned to the same task owner for more than two years. Resetting task assignee due to inactivity, to decrease task cookie-licking and to get a slightly more realistic overview of plans. Please feel free to assign this task to yourself again if you still realistically work or plan to work on this task - it would be welcome!

For tips how to manage individual work in Phabricator (noisy notifications, lists of task, etc.), see https://phabricator.wikimedia.org/T228575#6237124 for available options.
(For the records, two emails were sent to assignee addresses before resetting assignees. See T228575 for more info and for potential feedback. Thanks!)