Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {musk} [5 pts]
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	mforns
	Jul 22 2015, 5:33 PM

Description

When using --all-projects flag, the all.tsv files are created sometimes with non-intuitive date ranges.
Also, the created files need still to be tracked in the git repo.

the output is here:
https://metrics.wmflabs.org/static/public/datafiles/Pageviews/ in the file all.csv

Details

	Subject	Repo	Branch	Lines +/-
	Fix inconsistencies when using --all-projects	analytics/aggregator	master	+45 -2

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	• kevinator	T101120 {musk} Pageviews in Vital Signs
Duplicate	None	T95336 {Epic} Community reads pageviews per project in Vital Signs {crow}
Resolved	mforns	T106554 Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {musk} [5 pts]
Resolved	mforns	T95339 Add Pageview aggregation to Python {musk} [13 pts]

Event Timeline

mforns created this task.Jul 22 2015, 5:33 PM

mforns claimed this task.

mforns raised the priority of this task from to Needs Triage.

mforns updated the task description. (Show Details)

mforns added a project: Analytics-Kanban.

mforns subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 22 2015, 5:33 PM

• kevinator renamed this task from Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag to Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {slug}.Jul 22 2015, 5:38 PM

• kevinator added a subtask: T95339: Add Pageview aggregation to Python {musk} [13 pts].

• kevinator set Security to None.

• kevinator updated the task description. (Show Details)

• kevinator renamed this task from Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {slug} to Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {musk}.Jul 27 2015, 4:16 PM

• kevinator triaged this task as Medium priority.Jul 27 2015, 4:19 PM

• kevinator edited projects, added Analytics-Clusters, Analytics-Backlog; removed Analytics-Kanban.

• kevinator moved this task from Incoming to Medium on the Analytics-Backlog board.

• kevinator added a parent task: T101120: {musk} Pageviews in Vital Signs.Jul 28 2015, 4:39 AM

Milimetric moved this task from Medium to Prioritized on the Analytics-Backlog board.Aug 7 2015, 4:31 PM

mforns edited projects, added Analytics-Kanban; removed Analytics-Backlog.Sep 25 2015, 8:55 PM

mforns moved this task from Next Up to In Progress on the Analytics-Kanban board.

Change 241620 had a related patch set uploaded (by Mforns):
Fix inconsistencies when using --all-projects

https://gerrit.wikimedia.org/r/241620

gerritbot added a project: Patch-For-Review.Sep 28 2015, 11:09 AM

mforns moved this task from In Progress to In Code Review on the Analytics-Kanban board.Sep 28 2015, 11:09 AM

mforns renamed this task from Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {musk} to Python Aggregator: Solve inconsistencies in data ranges when using --all-projects flag {musk} [5 pts].Sep 28 2015, 11:32 AM

Change 241620 merged by Nuria:
Fix inconsistencies when using --all-projects

https://gerrit.wikimedia.org/r/241620

mforns moved this task from In Code Review to Ready to Deploy on the Analytics-Kanban board.Sep 28 2015, 3:06 PM

mforns moved this task from Ready to Deploy to Done on the Analytics-Kanban board.Sep 28 2015, 3:12 PM

mforns mentioned this in rANAGbfb9eec1ab90: Fix inconsistencies when using --all-projects.Sep 28 2015, 6:44 PM

• kevinator closed this task as Resolved.Sep 29 2015, 5:42 PM

• kevinator subscribed.

mforns added a parent task: T95336: {Epic} Community reads pageviews per project in Vital Signs {crow}.Oct 1 2015, 10:59 PM