Document known data quality issues on Wikistats
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	odimitrijevic
	Dec 14 2022, 11:50 PM

Description

There are a number of known data quality issues that affect the correctness of what is reported on Wikistats. These include:

Page View Loss - https://phabricator.wikimedia.org/T300164
Unique Devices Overcount: https://phabricator.wikimedia.org/T319213

While the long term solution to handle these issues is still TBD and still to be prioritized as per https://phabricator.wikimedia.org/T310732, an interim solution would be to provide a list of known issues and link from the relevant dashboards.

Possible solutions:

Have a page on Wikistats to outline the known issues and link from the affected dashboards
Outline data issues on Wikitech and link from the affected wikistats dashboards

Related Objects

Mentioned Here: T300164: Pageview Data loss due to wrong version of package installed on some varnishkafka instances
T310732: "Source of truth" dataset for pageviews
T319213: Backfill unique devices jobs [Tracking Task]

Event Timeline

odimitrijevic created this task.Dec 14 2022, 11:50 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 14 2022, 11:50 PM

odimitrijevic updated the task description. (Show Details)Dec 21 2022, 6:16 PM

• EChetty moved this task from Backlog to Pipelines on the Data-Engineering-Planning board.Jan 6 2023, 12:45 PM

It is possible to add annotations to the wikistats dashboards via meta. See https://meta.wikimedia.org/w/index.php?title=Config:Dashiki:Annotations/Wikistats/totalPageViews. Annotations have been created for the two above incidents. Let's review and assess if this is sufficient.

just to have this on record: the Wikistats annotation display system was thrown together quickly. It can be easily modified to include ranges, and it probably should be in this case and a few other cases. Annotations are great UX and I still think putting them on wiki is a great way to get the community involved.

JArguello-WMF removed a project: Data-Engineering-Planning.Jun 29 2023, 9:59 PM

JArguello-WMF added a project: Data Engineering and Event Platform Team.Jun 30 2023, 5:31 PM

JArguello-WMF added a project: Epic.Jun 30 2023, 5:34 PM

JArguello-WMF moved this task from Data Eng Backlog to Parent Tasks/Epics on the Data Engineering and Event Platform Team board.Jun 30 2023, 5:37 PM

JArguello-WMF edited projects, added Data Products; removed Data Engineering and Event Platform Team.Jul 1 2023, 12:07 AM

JArguello-WMF moved this task from Incoming to Epics / Initiatives / Projects in Process on the Data Products board.Jul 1 2023, 12:10 AM

VirginiaPoundstone moved this task from Epics / Initiatives / Projects in Process to Wikistats Backlog on the Data Products board.Aug 17 2023, 3:57 PM

TBurmeister subscribed.Nov 6 2023, 4:25 PM

I'd appreciate this issue being prioritized, given that it was identified as an important activity after the data loss.

The annotations have been added to the graphs:

Marking as resolved.

odimitrijevic closed this task as Resolved.Feb 23 2024, 1:44 AM