Change Details

By dividing the spectrum of ORES scores into discrete levels and labeling these in a way that makes their predictive value clear, enable users to effectively use the system to meet their reviewing needs. In the immediate future, this system will be used on the [[ https://phabricator.wikimedia.org/tag/edit-review-improvements-rc-page/ | ERI revisions to Recent Changes ]] and in the [[ https://phabricator.wikimedia.org/tag/edit-review-improvements-reviewstream/ | ReviewStream ]] feed. At present, here's how we're defining and describing these levels : **CONTRIBUTION QUALITY [Damaging]** **Very likely good** Edits with 90-100% probability of being helpful. **Likely good** Edits with 50-100% probability of being helpful. **May have problems** Edits with a 20-100% probability of being flawed or damaging. **Likely have problems** Edits with a 50-100% probability of being a flawed or damaging. **Very likely have problems** Edits with a 90-100% probability of being flawed or damaging. **USER INTENT (PREDICTED) [Good Faith]** **Very likely good faith** Edits with 93-100% probability of being in good faith. **Likely good faith** Edits with 50-100% probability of being in good faith. **Likely bad faith** Edits with 50-100% probability of being in bad faith. **Very likely bad faith** Edits with 90-100% probability of being in bad faith.

By dividing the spectrum of ORES scores into discrete levels and labeling these in a way that makes their predictive value clear, enable users to effectively use the system to meet their reviewing needs. In the immediate future, this system will be used on the [[ https://phabricator.wikimedia.org/tag/edit-review-improvements-rc-page/ | ERI revisions to Recent Changes ]] and in the [[ https://phabricator.wikimedia.org/tag/edit-review-improvements-reviewstream/ | ReviewStream ]] feed. As of Nov. 1 2016, here's how we're defining and describing these levels : **CONTRIBUTION QUALITY [Damaging]** **Very likely good** Highly accurate at finding almost all problem-free edits. **May have problems** Finds most flawed or damaging edits but with lower accuracy. **Likely have problems** Finds half of flawed or damaging edits with medium accuracy. **Very likely have problems** Highly accurate at finding the most obvious 30% of flawed or damaging edits. **USER INTENT [Good Faith]** **Very likely good faith** Highly accurate at finding almost all good-faith edits. **May be bad faith** Finds most bad-faith edits but with a lower accuracy. **Likely bad faith** Highly accurate at finding most obvious obvious 20% of bad-faith edits.

By dividing the spectrum of ORES scores into discrete levels and labeling these in a way that makes their predictive value clear, enable users to effectively use the system to meet their reviewing needs. In the immediate future, this system will be used on the [[ https://phabricator.wikimedia.org/tag/edit-review-improvements-rc-page/ | ERI revisions to Recent Changes ]] and in the [[ https://phabricator.wikimedia.org/tag/edit-review-improvements-reviewstream/ | ReviewStream ]] feed. At presentAs of Nov. 1 2016, here's how we're defining and describing these levels : **CONTRIBUTION QUALITY [Damaging]** **Very likely good** Edits with 90-100% probability of beHighly accurate at finding helpful. **Likely good**almost all problem-free edits. Edits with 50-100% probability of being helpful. **May have problems** Edits with a 20-100% probability of being flawed or damaging. Finds most flawed or damaging edits but with lower accuracy. **Likely have problems** Edits with a 50-100% probability of being a flawed or damaging. Finds half of flawed or damaging edits with medium accuracy. **Very likely have problems** Edits with a 90-100% probability of beingHighly accurate at finding the most obvious 30% of flawed or damaging edits. **USER INTENT (PREDICTED) [Good Faith]** **Very likely good faith** Edits with 93-100% probability of being in good faith. **LikelyHighly accurate at finding almost all good -faith** edits. Edits with 50-100% probability of being in good faith. **Likely**May be bad faith** Edits with 50-100% probability of being in bad faith. **Very lFinds most bad-faith edits but with a lower accuracy. **Likely bad faith** Edits with 90-100% probability of being inHighly accurate at finding most obvious obvious 20% of bad -faith edits.