Maniphest T336739

Post Oozie -> Airflow migration refactorings
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	Antoine_Quhen
	May 16 2023, 9:51 AM

Tags

Referenced Files

None

Subscribers

Description

During the migration from Oozie to Airflow, we have progressively refined helpers and defined conventions to write dags. We now have some refactoring to do.

This is a parent task to hold together different refactorings.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T336739 Post Oozie -> Airflow migration refactorings
		Open		None	T336738 Refactor our existing Airflow dags to use EasyDAG & DagProperties
		Open		None	T336741 Make sure all partitions sensors are using the Dataset helpers
		Resolved		JEbe-WMF	T336744 Harmonize tags across Airflow dags
		Resolved		JAllemandou	T336745 Split Cassandra Airflow dags by dataset
		Open		None	T340673 Update Airflow Documentation

Event Timeline

Antoine_Quhen created this task.May 16 2023, 9:51 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 16 2023, 9:51 AM

Antoine_Quhen added a subtask: T336738: Refactor our existing Airflow dags to use EasyDAG & DagProperties.May 16 2023, 9:52 AM

Antoine_Quhen added a subtask: T336741: Make sure all partitions sensors are using the Dataset helpers.May 16 2023, 9:58 AM

Antoine_Quhen moved this task from Backlog to Epics on the Data Pipelines board.

Antoine_Quhen added a subtask: T336744: Harmonize tags across Airflow dags.May 16 2023, 10:06 AM

Antoine_Quhen added a subtask: T336745: Split Cassandra Airflow dags by dataset.May 16 2023, 10:17 AM

odimitrijevic added a subtask: T340673: Update Airflow Documentation.Jun 28 2023, 4:34 PM

JArguello-WMF added a project: Data Engineering and Event Platform Team.Jun 30 2023, 5:30 PM

JArguello-WMF added a project: Epic.Jun 30 2023, 5:34 PM

JArguello-WMF moved this task from Data Eng Backlog to Parent Tasks/Epics on the Data Engineering and Event Platform Team board.

lbowmaker closed subtask T336745: Split Cassandra Airflow dags by dataset as Resolved.Jul 25 2023, 12:20 PM

VirginiaPoundstone closed subtask T336744: Harmonize tags across Airflow dags as Resolved.Tue, Sep 19, 2:36 PM