Public

Actions

(This post was copied from https://lists.wikimedia.org/pipermail/ai/2016-August/000049.html)

Hey,

This is the 15th weekly update from revision scoring team that we have sent
to this mailing list.

New developments:

• We'll no longer unnecessarily load the models into memory on the web workers[1].
• We can now score multiple models against the same revision ID for (essentially) free[2].
• Our precaching system will take advantage of this to drop load by about 3X[3].
• Update wmflabs deploy repo for new version of ORES[4].

Documentation & maintenance:

• We completed deployment and maintenance docs for Wiki labels[5], which means we've now got complete docs for our systems[6].
• We implemented basic continuous integration tests for the ORES extension[7].

Downtime:

• We had a 1 hour long downtime while trying to deploy new code to ores.wikimedia.org[8]. We've filed two critical tasks for making sure we don't make the mistake again[9,10].

1. https://phabricator.wikimedia.org/T134606 - Score multiple models with the same cached dependencies
2. https://phabricator.wikimedia.org/T139407 - Don't load models into memory of web workers
3. https://phabricator.wikimedia.org/T141376 - Update precached to group requests by model
4. https://phabricator.wikimedia.org/T141377 - Update wmflabs deploy repo for new version of ORES
5. https://phabricator.wikimedia.org/T131768 - Wikilabels deployment docs
6. https://phabricator.wikimedia.org/T106271 - Document maintenance tasks
7. https://phabricator.wikimedia.org/T140455 - CI test for ORES extension
8. https://wikitech.wikimedia.org/wiki/Incident_documentation/20160801-ORES
9. https://phabricator.wikimedia.org/T141823 - Set up password on ORES Beta redis server
10. https://phabricator.wikimedia.org/T141825 - Config beta ORES extension to use the beta ORES service

Sincerely,
Aaron from the Revision Scoring team

Edit: Note that when I copied this post, I forgot to copy the followups from the same month. See them all here:

• Aug 8th: https://lists.wikimedia.org/pipermail/ai/2016-August/000052.html
• Aug 16th: https://lists.wikimedia.org/pipermail/ai/2016-August/000066.html
• Aug 22nd: https://lists.wikimedia.org/pipermail/ai/2016-August/000070.html
• Aug 29th: https://lists.wikimedia.org/pipermail/ai/2016-August/000080.html