Page MenuHomePhabricator

Create project tag for Airflow
Closed, ResolvedPublic

Description

Name of the project tag: Data Pipelines

Type of project: Component

Description (read the best practices and include a sentence understandable to the public and without "This project is for tracking work related to..." noise, plus a link to further information!): Design, implementation and maintenance of Wikimedia's Airflow system. Apache Airflow is an open-source workflow manager software that allows several of WMF's teams to manage their data-related jobs.

View policy of the project itself: https://wikitech.wikimedia.org/wiki/Analytics/Systems/Airflow
Public (default)

Event Timeline

@mforns: Requested public project Data Pipelines has been created: Data Pipelines.

I assume this will supersede the "Airflow" column on https://phabricator.wikimedia.org/tag/analytics/ ? Should tickets in that column be tagged with Data Pipelines?

General info:
Interested people are welcome to join the project as members, and to watch the project in order to receive notifications on task updates.

Recommended practices for project and workboard management in Phabricator are available.

Feel free to bring up any questions you might have about Phabricator or about best ways to manage projects in Phabricator.

Enjoy!

@Aklapper Thanks a lot for creating the project!

I assume this will supersede the "Airflow" column on https://phabricator.wikimedia.org/tag/analytics/ ? Should tickets in that column be tagged with Airflow?

Yes, it will supersede it. However, we are currently migrating out of this board into Data-Engineering, and I plan on doing some grooming on those tasks anyway,
so I can tag them manually, thanks!

Aklapper claimed this task.

Alright :)