In T149761, we finalized the score ranges that define the 7 ORES filters evolved in T146333. In creating the 7 standardized filtering options for the ORES Quality and Intent filters, we strove to balance users' desires for accuracy versus breadth of coverage. To balance these factors, we used the numerical tables @Halfak created in T146280, which correlate ranges of ORES damaging and good-faith scores with their predicted precision and coverage stats. ([[ https://docs.google.com/a/wikimedia.org/spreadsheets/d/1E8DSx6aYKcdbB29boNx580Knzo7vx0Bc3VKI6JL2PSU/edit?usp=sharing | This spreadsheet ]] provides a more full-featured display of this data.)
It turns out that to produce similar results from filters in the 7 wikis besides en.wiki that will be in the first wave of releases for the RC page improvements (discussed in T150715), we need to adjust the scoring ranges for each wiki.
Below find the following for each of the 7 ORES filters __on en.wiki__: in square brackets, the score ranges we've settled on; in parentheses the precision and coverage stats a given range will produce. The goal of this task is to find the score ranges that will produce similar results in each of the 8 target wikis (see list below).
=Quality filters=
- **Very likely good** [0%-55%] (98.7% precision, 92.7% coverage)
- **May Have problems** [16%-100%] (14.9% precision, 91.1% coverage)
- **Likely Have Problems** [75%-100%] (43%% precision, coverage 46%)
- **Very Likely Have Problems** [??-100%] (??)
=User Intent Filters=
- **Very likely good faith** [35% -100%] (98.9 accuracy, 97.2 coverage)
- **May be bad faith** [0% - 65%] (77% coverage, accuracy 18.8)
- **Likely bad faith** [0%-15%] (49.1 precision, coverage 26%)
=Target Wikis=
- English Wikipedia
- Persian Wikipedia
- Dutch Wikipedia
- Polish Wikipedia
- Portuguese Wikipedia
- Russian Wikipedia
- Turkish Wikipedia
- Wikidata