Wikidata Analytics Bug Report
This task was generated using the Wikidata Analytics bug report form. Please use the task template linked on our project page to report bugs to the team. Thank you!
Behavior
Please provide a concise description of what you’re experiencing and what you’d expect to happen.
The WMDE DAG that generates the wmde.wd_query_segments_daily table has been failing since December 6th. We need to unbreak this as soon as possible.
Specifically the sensor is currently not passing, which is likely due to the usage of RestExternalTaskSensor and something change for the airflow-search.discovery instance URI.
Code where the sensor is defined: wd_query_segments_daily_dag.py#L78
Deadline
Please make the time sensitivity of this task clear with a date that it should be completed by. If there is no specific date, then the task will be triaged based on its priority.
19.12.2024 (I'm on vacation from 20.12.2024)
Information below this point is filled out by the task assignee.
Assignee Planning
Sub Tasks
A full breakdown of the steps to complete this task.
- Derive the exact cause and needed change
- Update external URI and also add in access to CA public key to get through TLS
- Open and MR
and test DAG with change- Testing not possible with RestExternalTaskSensor at this time given Airflow k8s migration status
- Redeploy DAG
Estimation
Estimate: 1 day
Actual:
Notes
Things that came up during the completion of this task, questions to be answered and follow up tasks.
- Note