Low RIsk Ozzie Migration: Wikidata CoEditor metric job
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Snwachukwu
	Apr 14 2022, 11:23 AM

Description

Goal:
Migrate the CoEditor wikidata metrics oozie job to Airflow. The Airflow job would no longer use this scala job 'https://gerrit.wikimedia.org/r/plugins/gitiles/analytics/refinery/source/+/refs/heads/master/refinery-job/src/main/scala/org/wikimedia/analytics/refinery/job/wikidata/CoEditors.scala" to generate and send query to Graphite. But rather use the new generic HiveToGraphite job which will generate the CoEditor metric by running a hql script and send the metric to graphite.

Job Details:

Input	Processing	Output
Hive Table	Spark	Graphite

Success Criteria:

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Create Hive Query to generate Wikidata CoEditors metrics	analytics/refinery	master	+57 -0

Status	Assigned	Task
Resolved	• odimitrijevic	T282033 Airflow collaborations
Resolved	• odimitrijevic	T271429 Replace Oozie with better workflow scheduler
Resolved	• odimitrijevic	T299074 Migrate Oozie jobs to Airflow
Resolved	Snwachukwu	T300021 Low Risk Oozie Migration: 4 wikidata metrics jobs
Resolved	Snwachukwu	T306177 Low RIsk Ozzie Migration: Wikidata CoEditor metric job

Snwachukwu updated the task description. (Show Details)

Change 780749 had a related patch set uploaded (by Snwachukwu; author: Snwachukwu):

[analytics/refinery@master] Create Hive Query to generate Wikidata CoEditors metrics

Snwachukwu updated the task description. (Show Details)

Change 780749 merged by Joal:

[analytics/refinery@master] Create Hive Query to generate Wikidata CoEditors metrics