Page MenuHomePhabricator

Update fiwiki thresholds based on new model
Open, NormalPublic

Description

An improved model has been deployed for fiwiki. Please update the Special:ORESModels thresholds.

Event Timeline

Halfak created this task.May 13 2019, 8:06 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 13 2019, 8:06 PM

We went up from 0.08 precision @ 0.90 recall to 0.26 prevision @ 0.90 recall. So that's quite a jump.

This is the difference between needing to review 50% of edits to catch 90% of the damage to only needing to review 15% of edits to catch 90% of the damage. HUGE!

Harej triaged this task as Normal priority.May 13 2019, 9:58 PM
Harej moved this task from Untriaged to Maintenance/cleanup on the Scoring-platform-team board.

Hmm, it definitely changed variation of damaging model values to better. No opinion yet for real life the difference.

Goodfaith model seems to be still pretty weird.

Yes. We will need to have the Growth-Team update the thresholds before they'll be reflected on-wiki. Essentially, that will complete this task.