Page MenuHomePhabricator

Train 'reverted' model for commonswiki
Open, LowestPublic


This is gonna be a difficult one probably due to the wide scope and multi-linguistic nature of Commons, but let's start the conversations about what options we have and any blockers there might be.

Event Timeline

Krinkle created this task.Oct 28 2015, 5:28 PM
Krinkle raised the priority of this task from to Needs Triage.
Krinkle updated the task description. (Show Details)
Krinkle added subscribers: Krinkle, Aklapper.
Restricted Application added a subscriber: Steinsplitter. · View Herald TranscriptOct 28 2015, 5:28 PM
Halfak added a subscriber: Halfak.Oct 31 2015, 4:56 PM

So, we've been hard at work making multi-lingual contexts work for us. We'll probably need to do some research on how to take advantage of it in the context of commons though.

When gets merged, we'll support detection of badwords/informals in the following languages:

  • Dutch
  • English
  • French
  • German
  • Hebrew
  • Indonesian
  • Italian
  • Persian
  • Portuguese
  • Spanish
  • Turkish
  • Vietnamese

It's just a matter of time until we finish the implementations of:

We need a native speaker to help us clean up some automatically generated lists for:

We haven't started work on other languages yet, but we can if there is demand. We'll prioritize working on languages where we can get a native speaker to help us review an automatically generated list of potential badwords.

Liuxinyu970226 set Security to None.
Restricted Application added a subscriber: StudiesWorld. · View Herald TranscriptDec 18 2015, 2:52 PM
Steinsplitter moved this task from Incoming to Backlog on the Commons board.Dec 19 2015, 11:59 AM
Halfak renamed this task from Add revision scoring for commonswiki to Train 'reverted' model for commonswiki.Mar 30 2016, 4:52 PM
Halfak moved this task from Untriaged to New development on the Scoring-platform-team board.
Halfak triaged this task as Lowest priority.Jul 14 2016, 3:02 PM
Restricted Application added a subscriber: Poyekhali. · View Herald TranscriptJul 14 2016, 3:02 PM
Restricted Application added a project: artificial-intelligence. · View Herald TranscriptFeb 6 2018, 3:09 PM