Status update (November 29th, 2016)
November 29th, 2016

(The post was copied from


This is the 30th and 31st weekly update from the revision scoring team that
we have sent to this mailing list. We accidentally skipped a week again.

New development:

  • We added a new "lowest" sensitivity level to ORES review tool. This new sensistivity level will only flag edits that ORES is very confident are actually damaging[1].
  • We applied the MediaWiki standard color palette to Wikilabels[2]
  • We generated a manually censored public dataset of spam/vandalism/attack pages[3]. This will help others to develop spam, vandalism and attack page detection models. See the publication of the dataset[4].
  • We've implement color-based confidence reporting for ORES damage detection[5]

Maintenance and robustness:

  • We updated the version of OOjs-UI that gets bundled with Wiki labels[6] and moved the static assets to a new repositiory[7]
  • We fixed an issue in the recscoring library[8] that caused ORES to return invalid JSON and rendered the UI useless[9].


  • We gave a 3 minute presentation on the state of ORES to Victoria Coleman, the WMF's new CTO[10].
  • We performed a basic analysis of Wikipedia article quality trends using the dataset we released a few weeks ago[11]. We'll have a more substantial analysis soon.
  • We made a post on the ORES review tool talk page[12,13] detailing how we plan to incorporate a new filtering strategy into the ORES review tool. Please join the discussion there.
  1. -- Add "Lowest" ORES sensitivity for fpr=0.1
  2. -- Apply ui standardization color palette to Wikilabels
  3. -- Create manually vetted dataset of spam/vandalism/attack pages
  5. -- Visually report damaging confidence
  6. -- Update bundled OOJS-ui with Wikilabels
  8. -- ORES ui is broken (text field disabled)
  10. -- ORES (a 2-3 minute presentation)
  11. -- Basic analysis of Wikipedia quality using monthly predictions
  12. -- Post about ORES review tool including ERI filters

Aaron from the Revision Scoring team

Written by Halfak on Jun 3 2017, 6:16 PM.
Principal Research Scientist