We need to make sure that Airflow SMTP/email configuration is working, so we'll create a DAG that fails on purpose, to check that we indeed receive the email.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T362788 Migrate Airflow to the dse-k8s cluster | |||
| Resolved | brouberol | T375715 Add maintenance DAGs to wmf_airflow_common | |||
| Resolved | brouberol | T376699 Create a DAG that ensures that email alerting is working |
Event Timeline
Comment Actions
brouberol opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/862
test_k8s: add a DAG that fails on purpose to test email configuration
Comment Actions
brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/862
test_k8s: add a DAG that fails on purpose to test email configuration
Comment Actions
The dag indeed failed but we got a couple of warnings related to our email configuration:
2024-10-08, 09:30:20 UTC] {logging_mixin.py:190} WARNING - /usr/local/lib/python3.11/site-packages/airflow/utils/email.py:155 RemovedInAirflow3Warning: Fetching SMTP credentials from configuration variables will be deprecated in a future release. Please set credentials using a connection instead.
[2024-10-08, 09:30:20 UTC] {configuration.py:1058} WARNING - section/key [smtp/smtp_user] not found in config