Page MenuHomePhabricator
Create Task
Maniphest T431005

Test content policy model on top 5 wikis
Open, Needs TriagePublic
Actions

Description

Background

Having tested the content policy models for suppressed content on English Wikipedia, test the cope-b-a4b model on the other 4 wikis that we are tracking with DE4: eswiki, frwiki, dewiki and jawiki.

We choose to test cope-b-a4b because it gives confidence scores, allowing us to set our own threshold according to volunteer-reported accuracy.

Details
  • Update the analysis pipeline to work with multiple wikis at once without losing data from previous runs
  • Run for the other 4 wikis and discuss the results with volunteers

Event Timeline

Tchanders created this task.Jul 2 2026, 4:48 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 2 2026, 4:48 PM
Tchanders added a project: WE4.12 Content policy model evaluation.Jul 6 2026, 1:05 PM
OKryva-WMF moved this task from In progress to Needs review on the Product Safety and Integrity (Sprint Venus Flytrap (Jun 29 - Jul 17)) board.Jul 7 2026, 11:47 AM
kostajh added a project: DE4.1 Platform capacity.Jul 16 2026, 11:47 AM
Tchanders updated the task description. (Show Details)Jul 16 2026, 2:14 PM
OKryva-WMF edited projects, added: Product Safety and Integrity (Sprint Clover (Jul 20 - Aug 7)); removed: Product Safety and Integrity (Sprint Venus Flytrap (Jun 29 - Jul 17)).Jul 20 2026, 1:58 PM
OKryva-WMF moved this task from Backlog to Needs review on the Product Safety and Integrity (Sprint Clover (Jul 20 - Aug 7)) board.Jul 20 2026, 1:58 PM
Tchanders added subscribers: sgrabarczuk, ZSinger-WMF, cwylo.Jul 24 2026, 1:27 PM

The analysis has been run for eswiki, dewiki, frwiki and jawiki, and spreadsheets shared containing the top-scoring revision IDs for each wiki in the whole of June for labelling.

OKryva-WMF edited projects, added: Product Safety and Integrity (Sprint Sunflower (Aug 11 - Aug 28)); removed: Product Safety and Integrity (Sprint Clover (Jul 20 - Aug 7)).Aug 11 2026, 1:52 PM
OKryva-WMF moved this task from Backlog to Needs review on the Product Safety and Integrity (Sprint Sunflower (Aug 11 - Aug 28)) board.
kostajh moved this task from Needs review to Done on the Product Safety and Integrity (Sprint Sunflower (Aug 11 - Aug 28)) board.Thu, Aug 27, 9:50 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits