Page MenuHomePhabricator

Train 'reverted' model for commonswiki
Open, LowestPublic

Description

This is gonna be a difficult one probably due to the wide scope and multi-linguistic nature of Commons, but let's start the conversations about what options we have and any blockers there might be.

Event Timeline

Krinkle created this task.Oct 28 2015, 5:28 PM
Krinkle raised the priority of this task from to Needs Triage.
Krinkle updated the task description. (Show Details)
Krinkle added subscribers: Krinkle, Aklapper.
Restricted Application added a subscriber: Steinsplitter. · View Herald TranscriptOct 28 2015, 5:28 PM
Halfak added a subscriber: Halfak.Oct 31 2015, 4:56 PM

So, we've been hard at work making multi-lingual contexts work for us. We'll probably need to do some research on how to take advantage of it in the context of commons though.

When https://github.com/wiki-ai/revscoring/pull/206 gets merged, we'll support detection of badwords/informals in the following languages:

  • Dutch
  • English
  • French
  • German
  • Hebrew
  • Indonesian
  • Italian
  • Persian
  • Portuguese
  • Spanish
  • Turkish
  • Vietnamese

It's just a matter of time until we finish the implementations of:

We need a native speaker to help us clean up some automatically generated lists for:

We haven't started work on other languages yet, but we can if there is demand. We'll prioritize working on languages where we can get a native speaker to help us review an automatically generated list of potential badwords.

Liuxinyu970226 set Security to None.
Restricted Application added a subscriber: StudiesWorld. · View Herald TranscriptDec 18 2015, 2:52 PM
Steinsplitter moved this task from Incoming to Backlog on the Commons board.Dec 19 2015, 11:59 AM
Halfak renamed this task from Add revision scoring for commonswiki to Train 'reverted' model for commonswiki.Mar 30 2016, 4:52 PM
Halfak moved this task from Untriaged to New development on the Scoring-platform-team board.
Halfak triaged this task as Lowest priority.Jul 14 2016, 3:02 PM
Restricted Application added a subscriber: Poyekhali. · View Herald TranscriptJul 14 2016, 3:02 PM
Restricted Application added a project: artificial-intelligence. · View Herald TranscriptFeb 6 2018, 3:09 PM