You know there is another airflow-common-usage task around, here it is: T237361

@ArielGlenn oh yeah, I remember that. At this point we've pretty much decided to go forward with AirFlow. I read T237361#5636979 and it seems to me you'll be able to do most of this on top of what we build here, but it would require some customization. Our requirements are a bit more basic, I think roughly:

• testable
• good UI for managing jobs (rerunning, checking status, etc.)
• good set of templates that handle common jobs (we would be writing these based on the jobs that get migrated to the system)

So where are you at in the process? You can follow this task until we have something that's more ready for others to try, or you can jump in with us to build the infrastructure, let me know and we can plan accordingly.

In T282033#7066226, @Milimetric wrote:

<snip>

So where are you at in the process? You can follow this task until we have something that's more ready for others to try, or you can jump in with us to build the infrastructure, let me know and we can plan accordingly.

Well the problem is that I'm in the process of still being the only person on dumps, so it's going to be a good while before I can actually do work. I would definitely be interested in following along on the task though and maybe poking about in how things are configured and rolled out, as it happens.