To be able to test all Refine datasets for production readiness we need to design and develop an automated tool that compares the new processing outputs to the ones currently in production.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | None | T307500 Airflow Hackathon (May 2022) | |||
| Open | None | T307505 Refine jobs should be scheduled by Airflow | |||
| Resolved | Antoine_Quhen | T361502 [Refine Refactoring] Define and implement a automated testing / comparison tool for config store configured datasets |
Event Timeline
Comment Actions
@Antoine_Quhen @Ahoelzl should https://gerrit.wikimedia.org/r/c/analytics/refinery/source/+/1051061 be attached to this task? Should this task be assigned to Antoine?