Page MenuHomePhabricator

What already available software can we build on for a job scheduler?
Open, HighPublic

Description

Instead of having a home grown pile of python scripts, what can we use as a building block for a job scheduler and manager?

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 1 2016, 10:08 PM
ArielGlenn triaged this task as Medium priority.Mar 1 2016, 10:09 PM
ArielGlenn raised the priority of this task from Medium to High.Mar 7 2016, 6:10 PM

Time to get started on this. If done properly it can be used for production of the current dumps as well, allowing us to remove several levels of annoying abstraction from the existing code.

To do:

  • Draft several usage scenarios for task submission, status check requests and more
  • Set out requirements for task manager/job scheduler/workflow manager
  • Evaluate existing software
  • Choose one!

Guess I'll turn these into subtasks so we can start tossing notes into them.

ArielGlenn moved this task from Backlog to active on the Dumps-Rewrite board.Apr 24 2017, 11:06 AM
Aklapper removed ArielGlenn as the assignee of this task.Jun 19 2020, 4:18 PM

This task has been assigned to the same task owner for more than two years. Resetting task assignee due to inactivity, to decrease task cookie-licking and to get a slightly more realistic overview of plans. Please feel free to assign this task to yourself again if you still realistically work or plan to work on this task - it would be welcome!

For tips how to manage individual work in Phabricator (noisy notifications, lists of task, etc.), see https://phabricator.wikimedia.org/T228575#6237124 for available options.
(For the records, two emails were sent to assignee addresses before resetting assignees. See T228575 for more info and for potential feedback. Thanks!)