Maniphest T206271

RC filters: Non-scored Bot edits displayed with ORES full-coverage filters
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	Etonkovidova
	Oct 4 2018, 10:04 PM

Description

Tested on enwiki (wmf.24).

Select 'Bot' edits filter and 'Page edits' and 'Page creation'. Add all "Contribution quality prediction" filters - there will be many non-scored Bot edits.
Apply highlighting color to all selected filters - entries will not be highlighted.

Screen Shot 2019-03-05 at 12.37.13 PM.png (556×1 px, 252 KB)

It does not seem like an issue with delayed scoring - the timestamps on non-scored bot edits are often older than for non-bot edits.

Screen Shot 2019-03-05 at 12.37.48 PM.png (614×1 px, 281 KB)

Full-coverage ORES filters return all results including of non-scored entries.
When all ORES filters from damaging or goodfaith (Contribution quality prediction or from User intent prediction) are selected, they provide full coverage. When there are entries that are not ORES-scored, such filters selection will display them anyway. However, the highlighting will not be applied since the results are not scored.

If user expects "Contribution quality prediction" filters to return scored results, it might be confusing to see non-scored entries. The result set is indistinguishable form just selecting "Bot", "Page edits", and "Page creation" filters.

Event Timeline

Etonkovidova created this task.Oct 4 2018, 10:04 PM

Restricted Application added a project: Machine-Learning-Team. · View Herald TranscriptOct 4 2018, 10:04 PM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

JTannerWMF moved this task from Inbox to Needs Discussion on the Growth-Team board.Oct 15 2018, 4:54 PM

SBisson changed the subtype of this task from "Task" to "Bug Report".Oct 16 2018, 1:10 PM

SBisson changed the subtype of this task from "Bug Report" to "Task".Oct 16 2018, 6:41 PM

Since this only occurs for the edge case in which a user selects all model scores, we will not prioritize. There is not a use case for selecting all model scores. We will re-evaluate if more users report it.

Ladsgroup moved this task from Unsorted to Backlog/Lift Wing on the Machine-Learning-Team board.Nov 28 2018, 6:42 AM

Ladsgroup edited projects, added MediaWiki-extensions-ORES; removed ORES.

Etonkovidova renamed this task from RC filters: Un-scored Bot edits in Namespaces displayed with ORES full-coverage filters to RC filters: Non-scored Bot edits displayed with ORES full-coverage filters.Mar 5 2019, 9:11 PM

Etonkovidova updated the task description. (Show Details)

Etonkovidova updated the task description. (Show Details)Mar 5 2019, 9:19 PM

Maintenance_bot moved this task from Backlog/Lift Wing to Backlog/ORES on the Machine-Learning-Team board.Jan 19 2021, 11:29 PM

MBinder_WMF added a project: Growth-Team-Filtering.Apr 15 2021, 6:56 PM

	F28332583: Screen Shot 2019-03-05 at 12.37.13 PM.png
	Mar 5 2019, 9:11 PM

	F28332587: Screen Shot 2019-03-05 at 12.37.48 PM.png
	Mar 5 2019, 9:11 PM

	F26310986: Screen Shot 2018-10-04 at 2.19.03 PM.png
	Oct 4 2018, 10:04 PM

	F26311030: Screen Shot 2018-10-04 at 2.20.57 PM.png
	Oct 4 2018, 10:04 PM

	F26311394: Screen Shot 2018-10-04 at 2.21.41 PM.png
	Oct 4 2018, 10:04 PM

RC filters: Non-scored Bot edits displayed with ORES full-coverage filtersOpen, Needs TriagePublicActions

Description

Event Timeline

RC filters: Non-scored Bot edits displayed with ORES full-coverage filters
Open, Needs TriagePublic
Actions