Maniphest T131779

Implement Pages Created & Count of Edits full vertical slice
Closed, ResolvedPublic0 Estimated Story Points
Actions

Assigned To

None

Authored By

	• Nuria
	Apr 4 2016, 5:26 PM

Tags

Referenced Files

None

Subscribers

Jdforrester-WMF

Description

Implement Pages Created & Count of Edits full vertical slice sourcing data from hdfs.

These going to be our prototype metrics used to set up a pipeline of mediawiki historical and real time data flowing into hdfs.

This is also a parent task.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		None	T120037 Vital Signs: Please provide an "all languages" de-duplicated stream for the Community/Content groups of metrics
		Resolved		None	T120036 Vital Signs: Please make the data for enwiki and other big wikis less sad, and not just be missing for most days
		Resolved		odimitrijevic	T130256 Wikistats 2.0.
		Resolved		None	T131779 Implement Pages Created & Count of Edits full vertical slice
		Resolved		mforns	T131782 Put data needed for edits metrics through Event Bus into HDFS
		Resolved		None	T131786 Load edit history data into Druid
		Duplicate		None	T141472 Research spike: load enwiki data into Druid to study lookup table performance
		Declined		JAllemandou	T134792 Spike - Slowly Changing Dimensions on Druid
		Resolved		JAllemandou	T141473 Productionize loading of edit data into Druid (contingent on success of research spike)
		Invalid		mforns	T141479 Reportupdater calculations for Pages Created and Edit counts

Event Timeline

• Nuria created this task.Apr 4 2016, 5:26 PM

• Nuria created subtask T131781: Read mw databases AND dumps (separately) to fill the revision_create schema.Apr 4 2016, 5:29 PM

• Nuria created subtask T131782: Put data needed for edits metrics through Event Bus into HDFS.

• Nuria created subtask T131786: Load edit history data into Druid .Apr 4 2016, 6:09 PM

JAllemandou moved this task from Incoming to Backlog (Later) on the Analytics board.Apr 11 2016, 4:39 PM

JAllemandou added subscribers: • ezachte, JAllemandou.Apr 22 2016, 4:41 PM

This comment was removed by JAllemandou.

Sorry, messed up in the tasks, commented on the wrong one.

nshahquinn-wmf subscribed.May 19 2016, 9:43 PM

Milimetric moved this task from Backlog (Later) to Dashiki on the Analytics board.Jun 2 2016, 5:11 PM

• Nuria closed subtask T131781: Read mw databases AND dumps (separately) to fill the revision_create schema as Declined.Jul 4 2016, 4:47 PM

• Nuria removed a subtask: T131781: Read mw databases AND dumps (separately) to fill the revision_create schema.Jul 27 2016, 8:07 PM

• Nuria created subtask T141479: Reportupdater calculations for Pages Created and Edit counts .

• Nuria moved this task from Dashiki to Backlog (Later) on the Analytics board.Sep 12 2016, 3:30 PM

mforns closed subtask T141479: Reportupdater calculations for Pages Created and Edit counts as Invalid.Sep 23 2016, 5:01 PM

• Nuria edited projects, added Analytics-Kanban; removed Analytics.Oct 5 2016, 4:52 PM

This task is been replaced by this one: https://phabricator.wikimedia.org/T143924

Closing as outdated

• Nuria closed this task as Resolved.Oct 5 2016, 4:58 PM

• Nuria closed subtask T131786: Load edit history data into Druid as Resolved.Mar 20 2017, 3:31 PM

• Nuria reopened subtask T131786: Load edit history data into Druid as Open.

• Nuria closed subtask T131786: Load edit history data into Druid as Resolved.Mar 23 2017, 6:40 PM

mforns closed subtask T131782: Put data needed for edits metrics through Event Bus into HDFS as Resolved.Aug 10 2020, 4:42 PM