Page MenuHomePhabricator

Initial Setup For Scheduler Repository
Closed, ResolvedPublic8 Estimated Story Points

Description

Create initial setup for Scheduler such location of DAGs, proto files etc. and docker configuration so we can start implementing DAGs for our services.

Notes:

  • docker setup docs
  • as we just use it as scheduler we would like to have it as a single instance, they have a good example of CeleryExecutor but we want to use LocalExecutor so we can run everything in single instance
  • also would like to avoid using puckel/docker-airflow image if possible and use apache/airflow
  • need to research if we can just run everything using single container

Related Objects

StatusSubtypeAssignedTask
ResolvedJArguello-WMF
ResolvedNone
Resolved dmemije

Event Timeline

Protsack.stephan raised the priority of this task from Low to Medium.Dec 2 2021, 4:44 PM
Protsack.stephan moved this task from Incoming to Sprint 9 Backlog on the Wikimedia Enterprise board.
AnnaMikla changed the task status from Open to In Progress.Dec 3 2021, 10:01 PM
dmemije set the point value for this task to 8.Dec 7 2021, 6:56 PM
AnnaMikla changed the task status from In Progress to Open.Dec 27 2021, 9:33 PM