Page MenuHomePhabricator

Update fiwiki ORES thresholds in RecentChanges
Open, MediumPublic

Description

An improved model has been deployed for fiwiki. Please update the Special:ORESModels thresholds.

Event Timeline

We went up from 0.08 precision @ 0.90 recall to 0.26 prevision @ 0.90 recall. So that's quite a jump.

This is the difference between needing to review 50% of edits to catch 90% of the damage to only needing to review 15% of edits to catch 90% of the damage. HUGE!

Harej triaged this task as Medium priority.May 13 2019, 9:58 PM
Harej moved this task from Unsorted to Maintenance/cleanup on the Machine-Learning-Team board.

Hmm, it definitely changed variation of damaging model values to better. No opinion yet for real life the difference.

Goodfaith model seems to be still pretty weird.

Yes. We will need to have the Growth-Team update the thresholds before they'll be reflected on-wiki. Essentially, that will complete this task.

pushing this little bit up. It would be nice to get goodfaith working.

@kostajh, it looks like we missed this one in the last round of updates. I expect this one will be as straightforward as the rest of the updates.

Halfak renamed this task from Update fiwiki thresholds based on new model to Update fiwiki ORES thresholds in RecentChanges.Sep 20 2019, 3:45 PM

Moving to upcoming work so we can tag it for a sprint soon.

pushing this little bit up. It would be nice to get goodfaith working.