Add ignore success flags option to pageview monthly dumps
Open, HighPublic
Actions

Assigned To

None

Authored By

	• fdans
	May 25 2021, 2:40 PM

Description

Since before 2015 there are a whole bunch of corrupted or missing hourly files coming from pagecounts_ez and pagecounts_raw, there should be an option to ignore the existence of _SUCCESS files to carry on with the backfilling.

Related Objects
Search...

Status	Assigned	Task
Open	None	T251777 Creation of canonical pageview dumps for users to download
Open	None	T192474 Migrate pagecounts-ez generation to hadoop
Resolved	JAllemandou	T265732 Create monthly job for canonical pageviews
Open	None	T283593 Add ignore success flags option to pageview monthly dumps

Event Timeline

• fdans created this task.May 25 2021, 2:40 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 25 2021, 2:40 PM

odimitrijevic assigned this task to • fdans.May 27 2021, 4:40 PM

odimitrijevic triaged this task as High priority.

odimitrijevic moved this task from Incoming to Smart Tools for Better Data on the Analytics board.

odimitrijevic added a parent task: T265732: Create monthly job for canonical pageviews.

(Resetting inactive assignee account)

odimitrijevic added a project: Data-Engineering.Nov 20 2021, 12:48 AM

odimitrijevic moved this task from Incoming (new tickets) to Datasets on the Data-Engineering board.

odimitrijevic removed a project: Analytics.Jan 12 2022, 12:18 AM

JArguello-WMF moved this task from Datasets to Data Products & Metrics on the Data-Engineering board.Jun 29 2023, 11:46 PM

lbowmaker moved this task from Data Products & Metrics to Icebox (not considered in current quarter) on the Data-Engineering board.Nov 10 2023, 2:25 PM

Add ignore success flags option to pageview monthly dumpsOpen, HighPublicActions

Description

Related ObjectsSearch...

Event Timeline

Add ignore success flags option to pageview monthly dumps
Open, HighPublic
Actions

Related Objects
Search...