Synchronise changes for productionisation of mediawiki history jobs
Closed, ResolvedPublic0 Estimated Story Points
Actions

Assigned To

Authored By

	JAllemandou
	Mar 10 2017, 8:41 AM

Description

Related tasks and patches:

Sqoop updates (add infra and version partitions) - T160152 - DONE
Static data update (differenciate prod and labs projects to sqoop) - T160153 - DONE
Create cron for sqooping (depends on sqoop updates and static data) - T160083 - DONE - Andrew
Spark job (huge patch) - T144717 - DONE
Metrics in Hive (tables and queries, no oozie) - T160155 - DONE
Oozie job for spark job (depends on metrics patch) - T160074 - DONE
Oozie job for metrics - T160151 - DONE
Oozie job for Druid loading - T141473 - DONE

Status	Assigned	Task
Resolved	None	T120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics
Resolved	None	T120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days
Resolved	odimitrijevic	T130256 Wikistats 2.0.
Resolved	None	T143924 Replacing standard edit metrics in dashiki with data from new edit data depot
Resolved	JAllemandou	T152035 Productionize Edit History Reconstruction and Extraction
Resolved	JAllemandou	T160154 Synchronise changes for productionisation of mediawiki history jobs