[Refine refactoring] Refactor and migrate navigationtiming to Airflow
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• lbowmaker
	Jan 30 2024, 4:21 PM

Description

Refactor and migrate navigationtiming to Airflow

Refactoring should make use of config store: https://phabricator.wikimedia.org/T355542

See overall plan here:

https://docs.google.com/document/d/16rlqXLpBcfgvA4iGgT4BdAA84OR-rDxk2dyC9UneV7c/edit

Details

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	Migrate and refactor Refine into Airflow dynamic DAG	repos/data-engineering/airflow-dags!617	aqu	T356362_dynamic_dag_poc	main

Customize query in GitLab

Related Objects
Search...

Status	Assigned	Task
Resolved	None	T307500 Airflow Hackathon (May 2022)
Open	None	T307505 Refine jobs should be scheduled by Airflow
Resolved	Antoine_Quhen	T356192 [Refine refactoring] Refactor and migrate navigationtiming to Airflow

Event Timeline

• lbowmaker created this task.Jan 30 2024, 4:21 PM

• lbowmaker edited projects, added Data-Engineering (Sprint 8); removed Data-Engineering.

Antoine_Quhen renamed this task from Refactor and migrate navigationtiming to Airflow to [Refine refactoring] Refactor and migrate navigationtiming to Airflow.Jan 31 2024, 3:52 PM

Ahoelzl edited projects, added Data-Engineering; removed Data-Engineering (Sprint 8).Feb 1 2024, 2:49 AM

aqu opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/617

Migrate and refactor Refine into Airflow dynamic DAG

aqu merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/617

Migrate and refactor Refine into Airflow dynamic DAG

Maintenance_bot removed a project: Patch-For-Review.Mar 25 2024, 10:30 PM

• lbowmaker moved this task from Incoming (new tickets) to Sprint 9 on the Data-Engineering board.Mar 26 2024, 12:12 AM

• lbowmaker edited projects, added Data-Engineering (Sprint 9); removed Data-Engineering.

Antoine_Quhen closed this task as Resolved.Mar 26 2024, 4:17 PM

Antoine_Quhen claimed this task.

Antoine_Quhen moved this task from Next Up to Done on the Data-Engineering (Sprint 9) board.