Maniphest T132590

Upgrade scripts to facilitate wiki data loading / treatment on hadoop
Closed, ResolvedPublic13 Estimated Story Points
Actions

Assigned To

Authored By

	JAllemandou
	Apr 13 2016, 3:23 PM

Tags

Referenced Files

None

Subscribers

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Halfak	T133957 Socialize metrics standardization work with analytics metrics work
		Resolved		JAllemandou	T132590 Upgrade scripts to facilitate wiki data loading / treatment on hadoop

Event Timeline

JAllemandou created this task.Apr 13 2016, 3:23 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 13 2016, 3:23 PM

JAllemandou claimed this task.Apr 13 2016, 3:23 PM

JAllemandou moved this task from Next Up to In Code Review on the Analytics-Kanban board.

https://github.com/wikimedia-research/research-cluster/pull/5

This is in regards to load editing data from dumps. Data is translated from xml into json and from those we create hive tables.

Restricted Application added a subscriber: TerraCodes. · View Herald TranscriptApr 19 2016, 5:15 PM

Code is here: https://github.com/jobar/research-cluster/tree/etl_checkers

• Nuria set the point value for this task to 13.Apr 19 2016, 5:17 PM

JAllemandou moved this task from In Code Review to Done on the Analytics-Kanban board.Apr 27 2016, 7:10 PM

JAllemandou added a parent task: T133957: Socialize metrics standardization work with analytics metrics work.Apr 29 2016, 8:39 AM

• Nuria closed this task as Resolved.May 3 2016, 4:47 PM