Maniphest T302876

Medium Risk Oozie Migration: mediarequest
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• EChetty
	Mar 2 2022, 1:55 PM

Tags

Referenced Files

None

Subscribers

Description

Goal:
Migrate the mediarequest jobs to Airflow:

Job Details:

Input	Processing	Output
Hive Table	Hive	Hive Table

Success Criteria:

Have the 1 hourly Job Migrated (SLA 6 Hours)

Details

	Project	Branch	Lines +/-	Subject
	analytics/refinery	master	+89 -0	Migrate mediarequest hourly from Oozie to Airflow

Customize query in gerrit

Event Timeline

• EChetty created this task.Mar 2 2022, 1:55 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 2 2022, 1:55 PM

• EChetty moved this task from Next Up (revisit every 2 sprints) to Discussed (Radar) on the Data Pipelines board.Mar 7 2022, 4:46 PM

• EChetty moved this task from Discussed (Radar) to Next Up (revisit every 2 sprints) on the Data Pipelines board.

• EChetty moved this task from Next Up (revisit every 2 sprints) to Discussed (Radar) on the Data Pipelines board.

Antoine_Quhen claimed this task.Mar 28 2022, 2:17 PM

Antoine_Quhen moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.

Antoine_Quhen added a project: Data-Engineering-Kanban.

Antoine_Quhen moved this task from Next Up to In Progress on the Data-Engineering-Kanban board.

https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/41

Change 775255 had a related patch set uploaded (by Aqu; author: Aqu):

[analytics/refinery@master] Migrate mediarequest hourly from Oozie to Airflow

https://gerrit.wikimedia.org/r/775255

gerritbot added a project: Patch-For-Review.Mar 30 2022, 7:47 AM

Change 775255 merged by Aqu:

[analytics/refinery@master] Migrate mediarequest hourly from Oozie to Airflow

https://gerrit.wikimedia.org/r/775255

Maintenance_bot removed a project: Patch-For-Review.Apr 11 2022, 12:30 PM

Antoine_Quhen moved this task from In Code Review to Ready to Deploy on the Data-Engineering-Kanban board.Apr 26 2022, 4:07 PM

Antoine_Quhen moved this task from In Review to Done on the Data Pipelines board.Apr 28 2022, 3:41 PM

Antoine_Quhen moved this task from Ready to Deploy to Done on the Data-Engineering-Kanban board.

JArguello-WMF closed this task as Resolved.May 31 2022, 3:28 PM