Meta ORES: UI/API for reviewing/refuting how ORES classifies you and your stuff
Open, LowPublic

Description

Build a user-friendly UI for reviewing how ORES has classified you or any query-able slice of activity.

Include UI & API to refute classifications endpoints (via OAuth).

Include UI to curate "refutations" (suppress & meta-review).

Notes:

  • Refutations need freeform text. Freeform text *must* have a suppression system.
  • We should include refutations in ORES query results.
  • We can borrow from MediaWiki's global user rights (ORES is global) for curation privs.

See also:

TODO:

  • Link to the wiki homepage for this initiative.

Related Objects

Halfak created this task.Oct 20 2016, 12:21 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 20 2016, 12:21 AM
Halfak renamed this task from Meta ORES: UI for reviewing how ORES classifies you to Meta ORES: UI for reviewing how ORES classifies you and your stuff.Oct 20 2016, 12:21 AM
Halfak updated the task description. (Show Details)Oct 20 2016, 12:32 AM
He7d3r added a subscriber: He7d3r.Oct 21 2016, 6:52 PM

@Halfak this is probably part of the plan already, but wanted to lobby for it if it isn't: there are two use cases for refutation, that I can see. One is the ethical (and possibly legal) issue around correcting misclassification of your own edits; the other (and just as important, IMO albeit for more practical than ethical reasons) is being able to refute ORES's classification of other peoples' edits.

Seems like the same system could support both of these use-cases. Thoughts?

Agreed. I'd include edits (or pages or users) you are concerned about in "your stuff".

I'd like to pursue this, but right now, it doesn't seem like I'll be able to pick it up soon as I'm heavily backlogged with operations engineering work on ORES. If we could get some additional engineering support on the team, I'd be picking this up as my next major project.

Would non-engineering support be helpful?

Good Q. Yes! I'd like to get this type of system well documented before-hand. We might even start imagining where we'd put a proof of concept refutation UI.

Halfak triaged this task as Low priority.Oct 27 2016, 2:28 PM
Halfak renamed this task from Meta ORES: UI for reviewing how ORES classifies you and your stuff to Meta ORES: UI/API for reviewing/refuting how ORES classifies you and your stuff.Dec 13 2016, 11:09 PM
awight updated the task description. (Show Details)Dec 13 2016, 11:35 PM
awight updated the task description. (Show Details)Dec 13 2016, 11:44 PM
Keegan added a subscriber: Keegan.May 1 2017, 9:30 PM
Zppix added a subscriber: Zppix.Jun 4 2017, 8:00 PM
Krinkle removed a subscriber: Krinkle.Nov 1 2017, 7:54 PM