Status update (August 2nd, 2016)
August 2nd, 2016

(This post was copied from https://lists.wikimedia.org/pipermail/ai/2016-August/000049.html)

Hey,

This is the 15th weekly update from revision scoring team that we have sent
to this mailing list.

New developments:

  • We'll no longer unnecessarily load the models into memory on the web workers[1].
  • We can now score multiple models against the same revision ID for (essentially) free[2].
  • Our precaching system will take advantage of this to drop load by about 3X[3].
  • Update wmflabs deploy repo for new version of ORES[4].

Documentation & maintenance:

  • We completed deployment and maintenance docs for Wiki labels[5], which means we've now got complete docs for our systems[6].
  • We implemented basic continuous integration tests for the ORES extension[7].

Downtime:

  • We had a 1 hour long downtime while trying to deploy new code to ores.wikimedia.org[8]. We've filed two critical tasks for making sure we don't make the mistake again[9,10].
  1. https://phabricator.wikimedia.org/T134606 - Score multiple models with the same cached dependencies
  2. https://phabricator.wikimedia.org/T139407 - Don't load models into memory of web workers
  3. https://phabricator.wikimedia.org/T141376 - Update precached to group requests by model
  4. https://phabricator.wikimedia.org/T141377 - Update wmflabs deploy repo for new version of ORES
  5. https://phabricator.wikimedia.org/T131768 - Wikilabels deployment docs
  6. https://phabricator.wikimedia.org/T106271 - Document maintenance tasks
  7. https://phabricator.wikimedia.org/T140455 - CI test for ORES extension
  8. https://wikitech.wikimedia.org/wiki/Incident_documentation/20160801-ORES
  9. https://phabricator.wikimedia.org/T141823 - Set up password on ORES Beta redis server
  10. https://phabricator.wikimedia.org/T141825 - Config beta ORES extension to use the beta ORES service

Sincerely,
Aaron from the Revision Scoring team

Edit: Note that when I copied this post, I forgot to copy the followups from the same month. See them all here:

Written by Halfak on Jun 3 2017, 4:29 PM.
Principal Research Scientist
Projects
Subscribers
None