Public

Actions

(This post was copied from https://lists.wikimedia.org/pipermail/ai/2016-October/000106.html)

Hey,

This is the 24th and 25th weekly update from revision scoring team that we
have sent to this mailing list. We skipped a week due to travel and other
work.

Maintenance and robustness:

• We improved the performance of RecentChanges fitlering in the ORES extension[1]
• We built and ran a maintenance script to clean up duplicate cached data for the ORES extension[2,3]
• We updated the editquality models for the new version of revscoring (1.3.0)[4] and made some upstream changes to json2tsv to make that easier[5]
• We quited down some of our error reporting so that our logs take up less space[6]

Datasets:

• We generated a dataset that uses the "wp10" prediction model to assess article quality in monthly intervals for English, French, and Russian Wikipedia[7]. This should enable new research into the quality dynamics of these wikis.
• We generated a dataset of vandalism, spam, and attack page creations for building a new "draft quality" model[8]

Communication:

• Presented about transparent/open AI development practices around ORES at the Association of Internet Researchers[9]

New development:

• We've made substantial progress towards adding ORES data to MediaWiki's api.php endpoints with rcshow=oresreview[10] and rvprop=ores[11]

1. https://phabricator.wikimedia.org/T146111 -- hidenondamaging=1 query is extremely slow on enwiki
2. https://phabricator.wikimedia.org/T145356 -- Ensure ORES data violating constraints do not affect production
3. https://phabricator.wikimedia.org/T145503 -- Build a maintenance script to clean up duplicate data
4. https://phabricator.wikimedia.org/T146410 -- Update editquality for revscoring 1.3.0
5. https://phabricator.wikimedia.org/T146939 -- Add type decoding support to tsv2json
6. https://phabricator.wikimedia.org/T146680 -- Quiet result.get Warning in tasks
7. https://phabricator.wikimedia.org/T145655 -- Generate monthly article quality dataset
8. https://phabricator.wikimedia.org/T135644 -- Generate spam and vandalism new page creation dataset
9. https://phabricator.wikimedia.org/T147706 -- Present about ORES transparency at AoIR
10. https://phabricator.wikimedia.org/T143616 -- Introduce rcshow=oresreview and similar ones
11. https://phabricator.wikimedia.org/T143614 -- Introduce ORES rvprop

Sincerely,
Aaron from the Revision Scoring team