Page MenuHomePhabricator
Create Task
Maniphest T364980

Create structured contents snapshot of people articles
Open, Needs TriagePublic
Actions

Description

As a PM, I want to create a sample set of Structured Contents EN Wikipedia namespace 0 of People with infoboxes, so that I can share with researchers.

Acceptance criteria
Snapshot of the EN Wiki that contains only articles related to people with parsed infoboxes.

ToDo

  • download english wikipedia snapshot
  • create a subset of all EN Wikipedia pages on People (approx 2M)
  • run infobox parser on that subset of pages
  • create a new snapshot of people with infoboxes
Description

This will enable collaboration opportunities to help quantify WME data's quality in the LLM space.

Event Timeline

SDelbecque-WMF created this task.Wed, May 15, 11:06 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptWed, May 15, 11:06 AM
SDelbecque-WMF moved this task from Incoming to To Be Estimated/To Be Discussed on the Wikimedia Enterprise board.Wed, May 15, 11:07 AM
Protsack.stephan renamed this task from Create full People sampleset to Create structured contents snapshot of people articles.Wed, May 15, 12:00 PM
Protsack.stephan updated the task description. (Show Details)
Protsack.stephan updated the task description. (Show Details)
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL