Maniphest T299398

Low Risk Oozie Migration: aqs
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Antoine_Quhen
	Jan 18 2022, 1:43 PM

Tags

Referenced Files

None

Subscribers

Description

Goal:
Migrate the aqs jobs to Airflow:

Job Details:

Input Processing Output
Hive Table Hive Archive
Success Criteria:

Have the 1 hourly Jobs Migrated (SLA 6 Hours)

Details

	Subject	Repo	Branch	Lines +/-
	Airflow: Fix links in error emails	operations/puppet	production	+7 -1
	Migrate AQS/hourly	analytics/refinery	master	+63 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		odimitrijevic	T282033 Airflow collaborations
		Resolved		odimitrijevic	T271429 Replace Oozie with better workflow scheduler
		Resolved		odimitrijevic	T299074 Migrate Oozie jobs to Airflow
		Resolved		Antoine_Quhen	T299398 Low Risk Oozie Migration: aqs

Event Timeline

Antoine_Quhen created this task.Jan 18 2022, 1:43 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 18 2022, 1:43 PM

Antoine_Quhen added a parent task: T299074: Migrate Oozie jobs to Airflow.Jan 18 2022, 1:44 PM

Ottomata moved this task from Next Up to In Progress on the Data-Engineering-Kanban board.Jan 18 2022, 5:23 PM

Change 756601 had a related patch set uploaded (by Aqu; author: Aqu):

[analytics/refinery@master] Migrate AQS/hourly

https://gerrit.wikimedia.org/r/756601

gerritbot added a project: Patch-For-Review.Jan 24 2022, 2:24 PM

Change 756017 had a related patch set uploaded (by Aqu; author: Aqu):

[operations/puppet@production] Airflow: Fix links in error emails

https://gerrit.wikimedia.org/r/756017

odimitrijevic moved this task from Incoming (new tickets) to Transform on the Data-Engineering board.Jan 25 2022, 6:45 AM

• EChetty moved this task from Backlog to Estimated on the Data Pipelines board.Jan 25 2022, 11:28 AM

• EChetty moved this task from Estimated to In Review on the Data Pipelines board.Jan 25 2022, 11:31 AM

• EChetty merged a task: T300027: Low Risk Oozie Migration: aqs.Jan 25 2022, 12:20 PM

• EChetty subscribed.

JAllemandou renamed this task from Migrate AQS hourly job to Low Risk Oozie Migration: aqs.Jan 25 2022, 2:01 PM

JAllemandou updated the task description. (Show Details)

JAllemandou merged a task: T300027: Low Risk Oozie Migration: aqs.

Antoine_Quhen moved this task from In Progress to In Code Review on the Data-Engineering-Kanban board.Feb 1 2022, 5:15 PM

Change 756601 merged by Mforns:

[analytics/refinery@master] Migrate AQS/hourly

https://gerrit.wikimedia.org/r/756601

• ntsako moved this task from In Code Review to Ready to Deploy on the Data-Engineering-Kanban board.Feb 28 2022, 3:52 PM

• ntsako moved this task from Ready to Deploy to In Code Review on the Data-Engineering-Kanban board.

Antoine_Quhen moved this task from In Code Review to Done on the Data-Engineering-Kanban board.Feb 28 2022, 4:09 PM

mforns moved this task from In Review to Done on the Data Pipelines board.Feb 28 2022, 4:39 PM

Change 756017 abandoned by Aqu:

[operations/puppet@production] Airflow: Fix links in error emails

Reason:

This feature is not used anyway.

https://gerrit.wikimedia.org/r/756017

Maintenance_bot removed a project: Patch-For-Review.May 3 2022, 7:30 AM

JArguello-WMF closed this task as Resolved.May 31 2022, 3:36 PM