Maniphest T304889

Airflow CI/CD Documentation
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• EChetty
	Mar 28 2022, 7:22 PM

Tags

Referenced Files

None

Subscribers

Description

Goal: Create useable and accessible documentation for our CI/CD process for deploying DAGs

Main Documentation Lists

Tutorials on creating and deploying a DAG using the CI/CD framework.
How-to-guides on configuring tests and understanding errors.
Technical Reference material that describe what was implemented.
An Explanation describing the technical approach.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T295199 [Airflow] User manual and documentation
		Resolved		Antoine_Quhen	T304889 Airflow CI/CD Documentation

Event Timeline

• EChetty created this task.Mar 28 2022, 7:22 PM

Aklapper added a project: Documentation.Mar 28 2022, 8:01 PM

• EChetty moved this task from Backlog to Next Up (revisit every 2 sprints) on the Data Pipelines board.Apr 11 2022, 1:43 PM

• EChetty moved this task from Next Up (revisit every 2 sprints) to Discussed (Radar) on the Data Pipelines board.Apr 11 2022, 1:45 PM

• EChetty moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.May 23 2022, 3:39 PM

• EChetty moved this task from Estimated to Discussed (Radar) on the Data Pipelines board.

• EChetty moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.May 23 2022, 3:54 PM

• EChetty moved this task from Estimated to Discussed (Radar) on the Data Pipelines board.

Antoine_Quhen claimed this task.May 23 2022, 3:57 PM

• EChetty added a project: Data-Engineering-Planning.Jun 30 2022, 3:05 PM

• EChetty moved this task from Backlog to Epics on the Data-Engineering-Planning board.Aug 1 2022, 1:07 PM

• EChetty moved this task from Discussed (Radar) to Epics on the Data Pipelines board.Aug 15 2022, 8:51 AM

• EChetty moved this task from Epics to Epics on the Data Pipelines board.

• EChetty updated the task description. (Show Details)Aug 19 2022, 12:10 PM

JArguello-WMF moved this task from Epics to Pipelines on the Data-Engineering-Planning board.Jun 29 2023, 9:42 PM

JArguello-WMF removed a project: Data-Engineering-Planning.Jun 29 2023, 10:00 PM

JArguello-WMF added a project: Data Engineering and Event Platform Team.Jun 30 2023, 5:31 PM

JArguello-WMF edited subscribers, added: Epic; removed: • EChetty.Jun 30 2023, 5:33 PM

JArguello-WMF moved this task from Data Eng Backlog to Parent Tasks/Epics on the Data Engineering and Event Platform Team board.Jun 30 2023, 5:37 PM

@Antoine does this still need to be implemented?

Covered here: https://wikitech.wikimedia.org/wiki/Data_Engineering/Systems/Airflow/Developer_guide