wmf_airflow_common library in the airflow-dags repository supports referencing different Airflow instances using pre-determined labels - this functionality being used to configure dataset sensors primarily.
Since we migrated to Airflow on Kubernetes, we've practically renamed our analytics instance to main, so this needs to be reflected in the wmf_airflow_common library too.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | brouberol | T362788 Migrate Airflow to the dse-k8s cluster | |||
| Resolved | • Stevemunene | T391075 Airflow migration to DSE k8s - cleanup once complete | |||
| Resolved | amastilovic | T393111 Update airflow-dags wmf_airflow_common library rename analytics to main |
This has been addressed in the following MR: https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1280