Page MenuHomePhabricator
Create Task
Maniphest T148700

JADE: UI/API for reviewing/refuting how ORES classifies you and your stuff
Closed, InvalidPublic
Actions

Description

https://www.mediawiki.org/wiki/JADE

Build a user-friendly UI for reviewing how ORES has classified you or any query-able slice of activity.

Include UI & API to refute classifications endpoints (via OAuth).

Include UI to curate "refutations" (suppress & meta-review).

Notes:

  • Refutations need freeform text. Freeform text *must* have a suppression system.
  • We should include refutations in ORES query results.
  • We can borrow from MediaWiki's global user rights (ORES is global) for curation privs.

See also:

Related Objects
Search...

Event Timeline

Halfak created this task.Oct 20 2016, 12:21 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 20 2016, 12:21 AM
Halfak renamed this task from Meta ORES: UI for reviewing how ORES classifies you to Meta ORES: UI for reviewing how ORES classifies you and your stuff.Oct 20 2016, 12:21 AM
Halfak updated the task description. (Show Details)Oct 20 2016, 12:32 AM
Halfak mentioned this in T147708: Facilitate Wikidev'17 main topic "Artificial Intelligence to build and navigate content".Oct 20 2016, 6:45 PM
He7d3r subscribed.Oct 21 2016, 6:52 PM
• Capt_Swing subscribed.Oct 26 2016, 3:43 PM
• Capt_Swing added a comment.Oct 26 2016, 3:45 PM

@Halfak this is probably part of the plan already, but wanted to lobby for it if it isn't: there are two use cases for refutation, that I can see. One is the ethical (and possibly legal) issue around correcting misclassification of your own edits; the other (and just as important, IMO albeit for more practical than ethical reasons) is being able to refute ORES's classification of other peoples' edits.

Seems like the same system could support both of these use-cases. Thoughts?

Halfak added a comment.Oct 26 2016, 3:48 PM

Agreed. I'd include edits (or pages or users) you are concerned about in "your stuff".

I'd like to pursue this, but right now, it doesn't seem like I'll be able to pick it up soon as I'm heavily backlogged with operations engineering work on ORES. If we could get some additional engineering support on the team, I'd be picking this up as my next major project.

• Capt_Swing added a comment.Oct 26 2016, 3:50 PM

Would non-engineering support be helpful?

Halfak added a comment.Oct 26 2016, 3:52 PM

Good Q. Yes! I'd like to get this type of system well documented before-hand. We might even start imagining where we'd put a proof of concept refutation UI.

Halfak triaged this task as Low priority.Oct 27 2016, 2:28 PM
Halfak mentioned this in T147929: Algorithmic dangers and transparency -- Best practices.Nov 18 2016, 10:55 PM
Nemo_bis subscribed.Nov 20 2016, 10:05 AM
Halfak mentioned this in T140278: Provide a space for reporting bad predictions.Dec 10 2016, 8:13 PM
Halfak renamed this task from Meta ORES: UI for reviewing how ORES classifies you and your stuff to Meta ORES: UI/API for reviewing/refuting how ORES classifies you and your stuff.Dec 13 2016, 11:09 PM
awight created subtask T153142: [Spec] Suppression system for JADE freeform text fields.Dec 13 2016, 11:13 PM
awight created subtask T153143: [Spec] ORES query results should include Jade refutations.Dec 13 2016, 11:21 PM
Halfak created subtask T153145: Meta ORES: API data storage and querying.Dec 13 2016, 11:24 PM
awight created subtask T153146: [Spike] [bike shed] Name the Meta ORES service.Dec 13 2016, 11:28 PM
awight created subtask T153147: [Spike] Should we integrate JADE with Flow?.Dec 13 2016, 11:30 PM
Halfak created subtask T153148: JADE: MVP UI affordances .Dec 13 2016, 11:32 PM
awight created subtask T153149: [Spec] Design meta ORES general wiki entity matching schema.Dec 13 2016, 11:34 PM
Halfak created subtask T153150: [Discuss] Could Wiki Labels backend be replaced with JADE?.Dec 13 2016, 11:34 PM
awight updated the task description. (Show Details)Dec 13 2016, 11:35 PM
awight updated the task description. (Show Details)Dec 13 2016, 11:44 PM
awight created subtask T153162: Design how Jade judgments feed into ORES model training.Dec 14 2016, 12:55 AM
awight created subtask T153219: BR-Discussion detector.Dec 14 2016, 6:19 PM
Keegan subscribed.May 1 2017, 9:30 PM
Zppix subscribed.Jun 4 2017, 8:00 PM
Halfak created subtask T171496: Design a collaborative judgement pattern for JADE.Jul 24 2017, 5:45 PM
Halfak removed a subtask: T171496: Design a collaborative judgement pattern for JADE.Jul 27 2017, 3:51 PM
Krinkle subscribed.Oct 5 2017, 11:23 PM
Crang115 subscribed.Oct 7 2017, 3:20 PM
awight closed subtask T153146: [Spike] [bike shed] Name the Meta ORES service as Resolved.Nov 1 2017, 5:21 PM
Krinkle unsubscribed.Nov 1 2017, 7:54 PM
• Seton subscribed.Feb 22 2018, 4:46 AM
Halfak renamed this task from Meta ORES: UI/API for reviewing/refuting how ORES classifies you and your stuff to JADE: UI/API for reviewing/refuting how ORES classifies you and your stuff.Mar 27 2018, 7:13 PM
Halfak added a project: Jade.
awight closed subtask T153145: Meta ORES: API data storage and querying as Resolved.Jun 26 2018, 12:21 PM
awight closed subtask T153142: [Spec] Suppression system for JADE freeform text fields as Invalid.Jun 26 2018, 12:24 PM
awight closed subtask T153147: [Spike] Should we integrate JADE with Flow? as Declined.Jun 26 2018, 12:27 PM
awight closed subtask T153149: [Spec] Design meta ORES general wiki entity matching schema as Resolved.Jun 26 2018, 12:30 PM
Harej raised the priority of this task from Low to Medium.Jul 6 2018, 2:34 AM
Harej removed a project: ORES.
Harej updated the task description. (Show Details)
Harej moved this task from Inbox to In Progress on the Jade board.
Harej subscribed.

When will this task be considered done? How does it relate in scope to T183381?

Halfak added a comment.Jul 6 2018, 3:36 PM

This task is intended to collect all sub-tasks related to getting JADE online and predates the Jade project tag. We could maybe discard it now.

Harej closed this task as Invalid.Jul 6 2018, 4:05 PM
Harej closed subtask T153148: JADE: MVP UI affordances as Resolved.Jul 9 2018, 4:25 PM
Harej closed subtask T153150: [Discuss] Could Wiki Labels backend be replaced with JADE? as Declined.Sep 10 2018, 8:07 PM
ElanHR subscribed.Feb 13 2019, 6:46 PM
• ACraze closed subtask T153143: [Spec] ORES query results should include Jade refutations as Declined.Jul 13 2021, 9:08 PM
• ACraze closed subtask T153162: Design how Jade judgments feed into ORES model training as Declined.
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits