Page MenuHomePhabricator
Create Task
Maniphest T179692

Enhance mediawiki-history page reconstruction with best historical information possible
Open, LowPublic
Actions

Description

This task is about providing as correct and precise as possible data about deletes and restores patterns.

First patch of restore semantic revision has been made (see T179690). In that patch, historical data is set to null before any restore in a page history.

Idea here is to enhance what exists:

  • Add historical threads for pages with restores (revisions in that page might have been merged-in from different pages, list those, with correct times of overlap)
  • Provide correct historical titles when available (single historical thread), or a list of potential historical titles.
  • Join archived revisions to pages by title

Some examples of complex flows of events are described here and here

Related Objects

Event Timeline

JAllemandou created this task.Nov 3 2017, 1:57 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 3 2017, 1:57 PM
JAllemandou mentioned this in T179690: Fix mediawiki-history page reconstruction bug (deletes and restores) - simple patch.Nov 3 2017, 1:57 PM
JAllemandou renamed this task from Fix mediawiki-history page reconstruction bug (restores final) to Enhance mediawiki-history page reconstruction with best historical information possible.Nov 23 2017, 1:07 PM
JAllemandou edited projects, added Analytics; removed Analytics-Kanban.Nov 30 2017, 11:08 AM
• fdans moved this task from Incoming to Dashiki on the Analytics board.Dec 4 2017, 5:08 PM
JAllemandou updated the task description. (Show Details)Jan 3 2018, 12:39 PM
JAllemandou moved this task from Dashiki to Wikistats on the Analytics board.Jan 4 2018, 6:04 PM
JAllemandou merged a task: T183975: continue to improve computation for pages, deletion/restores.
JAllemandou added a subscriber: • Nuria.
Milimetric moved this task from Wikistats to Backlog (Later) on the Analytics board.Mar 1 2018, 6:23 PM
• Nuria added a parent task: T204953: Data quality issues in the mediawiki_history data stream.Sep 26 2018, 5:36 PM
Milimetric subscribed.Oct 2 2018, 4:23 PM

For complex flows of events that we can't reconcile automatically with a somewhat high degree of certainty, we had an idea:

describe the problem in a way that's easy to illustrate to the community of researchers, and allow them to piece together the puzzle. Capture the output of their work in a way that we can incorporate in the reconstruction algorithm, and use it to fix the ambiguous histories.

And for the rest of the task, see if there's any way we can be more certain about some of the less complex flows.

nshahquinn-wmf subscribed.Dec 19 2018, 8:17 PM
Milimetric triaged this task as Low priority.Mar 9 2020, 4:30 PM
Milimetric moved this task from Backlog (Later) to Data Quality on the Analytics board.
odimitrijevic removed a parent task: T204953: Data quality issues in the mediawiki_history data stream.Oct 27 2021, 10:37 PM
Aklapper added a project: Data-Engineering-Icebox.Feb 10 2023, 5:44 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits