Wrong file names for 2 month files in pageview_complete/monthly
Closed, ResolvedPublicBUG REPORT
Actions

Assigned To

Authored By

	Dusan_Krehel
	May 1 2023, 2:04 PM

Description

Steps to replicate the issue (include links if applicable):

Open urls:
- https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-03/
- or https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-04/

What happens?:
The files have the wrong file name.

What should have happened instead?:
Its havae the right file name as YYYYDD, but it's YYYYMM01 now.

Event Timeline

Dusan_Krehel created this task.May 1 2023, 2:04 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 1 2023, 2:04 PM

Aklapper renamed this task from The wrong file names for 2 month files in pageview_complete/monthly to Wrong file names for 2 month files in pageview_complete/monthly.May 1 2023, 3:32 PM

Aklapper added a project: Dumps-Generation.

Milimetric edited projects, added Data Pipelines, Data-Engineering; removed Dumps-Generation.May 2 2023, 12:25 AM

After a few hours, this is what I get now (4:33 UTC):

For March https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-03/

pageviews-20230301-automated.bz2                   06-Apr-2023 17:41          2134085440
pageviews-20230301-user.bz2                        06-Apr-2023 18:02          2828790361

For April
https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-04/

pageviews-20230401-automated.bz2                   01-May-2023 01:26          1407731763
pageviews-20230401-user.bz2                        01-May-2023 01:54          2742582238

And for February https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-02/

../
pageviews-202302-automated.bz2                     01-Mar-2023 04:27          1881417415
pageviews-202302-spider.bz2                        01-Mar-2023 04:27          6470852062
pageviews-202302-user.bz2                          01-Mar-2023 04:27          2633512512

JArguello-WMF moved this task from Incoming (new tickets) to Event Platform Backlog on the Data-Engineering board.Jun 29 2023, 10:37 PM

JArguello-WMF added a project: Data Engineering and Event Platform Team.Jun 30 2023, 5:52 PM

• lbowmaker removed a project: Data Engineering and Event Platform Team.Nov 10 2023, 2:49 PM

• lbowmaker moved this task from Event Platform Backlog to Incoming (new tickets) on the Data-Engineering board.

https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-03/

../
pageviews-202303-automated.bz2                     06-Apr-2023 17:41          2134085440
pageviews-202303-user.bz2                          06-Apr-2023 18:02          2828790361

And October https://dumps.wikimedia.org/other/pageview_complete/monthly/2023/2023-10/ has:

pageviews-202310-automated.bz2                     01-Nov-2023 02:03          3346959412
pageviews-202310-user.bz2                          01-Nov-2023 02:05          3114692461

So whatever generates the monthly page views is now back to generating files with YYYYMM and got rid of the YYYYMM01 format.

Wrong file names for 2 month files in pageview_complete/monthlyClosed, ResolvedPublicBUG REPORTActions

Description

Event Timeline

Wrong file names for 2 month files in pageview_complete/monthly
Closed, ResolvedPublicBUG REPORT
Actions