Airflow supports calling a function when a task SLA is missed.
We could leverage that miss_sla_callback parameter to automatically create a Phabricator ticket with the appropriate tags, recipients, links, etc, to track the progress (or lack thereof) of the dumps.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | brouberol | T398436 Future improvements to the Dumps on Airflow configuration - tracking task | |||
| Open | None | T389774 Automatically create a phabricator ticket when a dump SLA is missed |
We have decided not to implement dump SLAs for the first month or so, so we will defer a decision on this. The failure emails will to to data-engineering-alerts as well, so failure handling can be a part of regular Ops Week.