We have made recent contributions to the KubernetesPodExecutor:
Once apache-airflow-providers-cncf-kubernetes 10.14.0 is out, we can integrate the associated improvements our dump DAGs.
We have made recent contributions to the KubernetesPodExecutor:
Once apache-airflow-providers-cncf-kubernetes 10.14.0 is out, we can integrate the associated improvements our dump DAGs.
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| test_k8s: Take advantage of new KubernetesPodOperator template fields | repos/data-engineering/airflow-dags!1198 | brouberol | T390186 | main |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T88728 Improve Wikimedia dumping infrastructure | |||
| Resolved | BTullis | T352650 WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes | |||
| Resolved | brouberol | T388378 Orchestrate dumps v1 from an airflow instance | |||
| Resolved | brouberol | T390186 Integrate recent contributions to the KubernetesPodExecutor |
brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1198
test_k8s: Take advantage of new KubernetesPodOperator template fields