Maniphest T300028

Low Risk Oozie Migration: APIs
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• EChetty
	Jan 25 2022, 11:55 AM

Tags

Referenced Files

None

Subscribers

Description

Goal:
Migrate the API Logging jobs to Airflow:

Job Details:

Input	Processing	Output
Hive Table	Spark	Graphite

Success Criteria:

Have the 1 hourly Jobs Migrated (SLA 6 Hours)

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Create Hql script to generate API(rest and action) metrics.	analytics/refinery	master	+51 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		• odimitrijevic	T282033 Airflow collaborations
		Resolved		• odimitrijevic	T271429 Replace Oozie with better workflow scheduler
		Resolved		• odimitrijevic	T299074 Migrate Oozie jobs to Airflow
		Resolved		Snwachukwu	T300028 Low Risk Oozie Migration: APIs

Event Timeline

• EChetty created this task.Jan 25 2022, 11:55 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 25 2022, 11:55 AM

• EChetty added a parent task: T299074: Migrate Oozie jobs to Airflow.Jan 25 2022, 12:01 PM

JAllemandou updated the task description. (Show Details)Jan 25 2022, 1:06 PM

JAllemandou updated the task description. (Show Details)

• odimitrijevic moved this task from Incoming (new tickets) to Transform on the Data-Engineering board.Feb 1 2022, 11:11 PM

• EChetty moved this task from Backlog to Discussed (Radar) on the Data Pipelines board.Feb 8 2022, 11:43 AM

Snwachukwu claimed this task.Feb 28 2022, 4:13 PM

• EChetty moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.Feb 28 2022, 4:16 PM

• EChetty moved this task from Estimated to Discussed (Radar) on the Data Pipelines board.Feb 28 2022, 4:44 PM

• EChetty moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.Mar 7 2022, 4:34 PM

Snwachukwu moved this task from Estimated to Discussed (Radar) on the Data Pipelines board.Mar 14 2022, 2:52 PM

• EChetty moved this task from Discussed (Radar) to Estimated on the Data Pipelines board.Mar 21 2022, 3:56 PM

Snwachukwu moved this task from Estimated to In Review on the Data Pipelines board.Mar 22 2022, 4:14 PM

Snwachukwu added a project: Data-Engineering-Kanban.

Snwachukwu moved this task from In Review to Estimated on the Data Pipelines board.

• EChetty triaged this task as Low priority.Apr 1 2022, 2:33 PM

• EChetty lowered the priority of this task from Low to Lowest.

• EChetty raised the priority of this task from Lowest to Unbreak Now!.

• EChetty lowered the priority of this task from Unbreak Now! to Medium.

Milimetric moved this task from Next Up to In Progress on the Data-Engineering-Kanban board.Apr 13 2022, 4:12 PM

Change 785153 had a related patch set uploaded (by Snwachukwu; author: Snwachukwu):

[analytics/refinery@master] Create Hql script to generate API(rest and action) metrics.

https://gerrit.wikimedia.org/r/785153

gerritbot added a project: Patch-For-Review.Apr 21 2022, 12:26 PM

Change 785153 merged by Mforns:

[analytics/refinery@master] Create Hql script to generate API(rest and action) metrics.

https://gerrit.wikimedia.org/r/785153

Maintenance_bot removed a project: Patch-For-Review.May 4 2022, 12:31 PM

Antoine_Quhen moved this task from In Progress to In Code Review on the Data-Engineering-Kanban board.May 4 2022, 4:07 PM

Snwachukwu moved this task from In Code Review to Ready to Deploy on the Data-Engineering-Kanban board.May 5 2022, 4:39 PM

JAllemandou moved this task from Ready to Deploy to Done on the Data-Engineering-Kanban board.May 9 2022, 3:05 PM

Snwachukwu moved this task from Estimated to In Review on the Data Pipelines board.May 11 2022, 6:04 PM

Snwachukwu moved this task from In Review to Done on the Data Pipelines board.

JArguello-WMF closed this task as Resolved.May 31 2022, 3:26 PM