⚓ T406263 mediawiki_history_reduced - add page_id and user_central

Subject	Repo	Branch	Lines +/-
Fix issues with mediawiki_history_reduced table	analytics/refinery	master	+43 -21
Add user central ID columns to mediawiki_history tables	analytics/refinery	master	+17 -0
Add user_central_id to the mediawiki_history dataset(s)	analytics/refinery/source	master	+559 -290

Status	Assigned	Task
Resolved	HNordeenWMF	T382442 [Epic] iOS Wikipedia Year in Review 2025 (V3)
Resolved	HNordeenWMF	T388060 [Sub-Epic] [WE 3.2.9] On-device statistics Improvements for Year in Review 2025
Open	None	T341649 Provide an easy way for MediaWiki to fetch aggregate data from the data lake
Open	None	T388455 [Spike] Full-year editing stats for Year in Review
Resolved	Ottomata	T403660 WE3.3.7 Year in Review and Activity Tab Services - Global Editor Metrics
Resolved	amastilovic	T405039 Global Editor Metrics - Data Pipeline
Declined	amastilovic	T406069 Global Editor Metrics - Druid mediawiki_history_reduced changes
Resolved	amastilovic	T406263 mediawiki_history_reduced - add page_id and user_central_id fields

Ottomata created this task.Oct 2 2025, 7:08 PM

Ottomata assigned this task to amastilovic.Oct 2 2025, 7:55 PM

Ottomata updated the task description. (Show Details)

JAllemandou moved this task from Next Up to In progress on the Data-Engineering (Q1 FY25/26 July 1st - September 30th) board.Oct 6 2025, 3:10 PM

Ottomata mentioned this in T406069: Global Editor Metrics - Druid mediawiki_history_reduced changes.Oct 6 2025, 6:13 PM

Ottomata mentioned this in T406515: Add user_central_id to mediawiki_content_history_v1 (and mediawiki_content_current_v1).Oct 6 2025, 6:23 PM

Ottomata mentioned this in T405039: Global Editor Metrics - Data Pipeline.Oct 6 2025, 6:27 PM

Ahoelzl edited projects, added Data-Engineering (Q2 FY25/26 October 1st - December 31th); removed Data-Engineering (Q1 FY25/26 July 1st - September 30th).Oct 9 2025, 12:20 AM

Ahoelzl moved this task from Next Up to In progress on the Data-Engineering (Q2 FY25/26 October 1st - December 31th) board.

Change #1194951 had a related patch set uploaded (by Aleksandar Mastilovic; author: Aleksandar Mastilovic):

[analytics/refinery/source@master] Add user_central_id to the mediawiki_history dataset

https://gerrit.wikimedia.org/r/1194951

gerritbot added a project: Patch-For-Review.Oct 9 2025, 2:11 PM

otto opened https://gitlab.wikimedia.org/repos/generated-data-platform/aqs/aqs-docker-druid-test-env/-/merge_requests/8

Add page_id, user_id, and page_id to test data

Change #1195348 had a related patch set uploaded (by Aleksandar Mastilovic; author: Aleksandar Mastilovic):

[analytics/refinery@master] Add user central ID columns to mediawiki_history tables

https://gerrit.wikimedia.org/r/1195348

otto merged https://gitlab.wikimedia.org/repos/generated-data-platform/aqs/aqs-docker-druid-test-env/-/merge_requests/8

Add page_id, user_id, and user_central_id to test data

Ottomata updated the task description. (Show Details)Oct 20 2025, 6:12 PM

Change #1194951 merged by Aleksandar Mastilovic:

[analytics/refinery/source@master] Add user_central_id to the mediawiki_history dataset(s)

https://gerrit.wikimedia.org/r/1194951

Change #1195348 merged by Aleksandar Mastilovic:

[analytics/refinery@master] Add user central ID columns to mediawiki_history tables

https://gerrit.wikimedia.org/r/1195348

Maintenance_bot removed a project: Patch-For-Review.Oct 21 2025, 3:30 PM

Change #1198607 had a related patch set uploaded (by Aleksandar Mastilovic; author: Aleksandar Mastilovic):

[analytics/refinery@master] Fix issues with mediawiki_history_reduced table

https://gerrit.wikimedia.org/r/1198607

gerritbot added a project: Patch-For-Review.Oct 24 2025, 11:46 PM

Change #1198607 merged by Aleksandar Mastilovic:

[analytics/refinery@master] Fix issues with mediawiki_history_reduced table

https://gerrit.wikimedia.org/r/1198607

Maintenance_bot removed a project: Patch-For-Review.Oct 28 2025, 1:30 AM

amastilovic updated the task description. (Show Details)Oct 28 2025, 8:20 PM

user_id, user_central_id and page_id fields are now available in both the Hive dataset wmf.mediawiki_history_reduced as well as in the corresponding Druid dataset.

xcollazo moved this task from In progress to Done on the Data-Engineering (Q2 FY25/26 October 1st - December 31th) board.Nov 3 2025, 4:07 PM

Ahoelzl closed this task as Resolved.Nov 18 2025, 10:26 PM

mediawiki_history_reduced - add page_id and user_central_id fields
Closed, ResolvedPublic
Actions

Description

Done is

Nice to have is

Details

Related Objects
Search...

Event Timeline

mediawiki_history_reduced - add page_id and user_central_id fieldsClosed, ResolvedPublicActions