Page MenuHomePhabricator
Create Task
Maniphest T137966

Include goodfaith model information in ORES review tool
Closed, ResolvedPublic
Actions

Description

When ORES has "goodfaith" predictions available, they should be included in the review tool UI.

  • Design: how will goodfaith predictions be included in the UI
  • Populate the ores_classification table with goodfaith predictions
  • Implement the designed UI elements

Details

SubjectRepoBranchLines +/-
[WIP] Add goodfaith filteringmediawiki/extensions/ORESmaster+75 -31
Store goodfaith scores in the ORES tablesoperations/mediawiki-configmaster+1 -1
Customize query in gerrit

Related Objects
Search...

Event Timeline

Halfak created this task.Jun 16 2016, 2:38 PM
Restricted Application added subscribers: Zppix, Aklapper. · View Herald TranscriptJun 16 2016, 2:38 PM
Ladsgroup added a project: Machine-Learning-Team.Jul 4 2016, 2:05 AM
Halfak merged a task: T140360: Add flag to review tool for 'goodfaith'.Jul 14 2016, 2:44 PM
Halfak moved this task from Unsorted to New development on the Machine-Learning-Team board.
Halfak triaged this task as Medium priority.Jul 14 2016, 2:51 PM
Quiddity subscribed.Aug 8 2016, 6:07 PM
Catrope added a project: Edit-Review-Improvements.Aug 8 2016, 6:19 PM
Restricted Application added a project: Collaboration-Team-Triage. · View Herald TranscriptAug 8 2016, 6:19 PM
Krinkle subscribed.Aug 8 2016, 6:21 PM
Halfak updated the task description. (Show Details)Aug 25 2016, 2:26 PM
Halfak mentioned this in T142785: Design interface for displaying and filtering ORES Good-Faith and Damaging scores as well as New Users flag.Aug 25 2016, 2:28 PM
• jmatazzoni subscribed.Aug 25 2016, 10:27 PM
• jmatazzoni added a comment.Aug 25 2016, 10:30 PM

We're looking into this question pretty thoroughly as part of Edit Review Improvements. See

T142785, T143455, T143452, T143451

It might make sense to tie this in with those projects, so that we don't train users on one way of using scores and then switch them.

Halfak added a comment.Aug 25 2016, 10:38 PM

@jmatazzoni agreed on the overlap. Though, I wonder if it would be worthwhile to enact a technology probe[1] through the ORES extension so that we get better feedback about redesigns.

  1. https://www.lri.fr/~mackay/pdffiles/CHI03.probes.pdf
Trizek-WMF subscribed.Aug 26 2016, 4:45 PM
• jmatazzoni moved this task from Backlog to Development on the Edit-Review-Improvements board.Sep 1 2016, 7:16 PM
Halfak moved this task from Backlog to Prioritized on the MediaWiki-extensions-ORES board.Sep 8 2016, 2:43 PM
Halfak added a parent task: T144922: Visually report damaging confidence.
Catrope claimed this task.Sep 12 2016, 9:25 PM
Catrope edited projects, added Collab-Team-Q1-July-Sep-2016; removed Collaboration-Team-Triage.
Catrope moved this task from Untriaged to In Development on the Collab-Team-Q1-July-Sep-2016 board.
• jmatazzoni added a subscriber: Pginer-WMF.Sep 13 2016, 12:25 AM
gerritbot subscribed.Sep 22 2016, 3:24 AM

Change 312166 had a related patch set uploaded (by Catrope):
[WIP] Add goodfaith filtering

https://gerrit.wikimedia.org/r/312166

gerritbot added a project: Patch-For-Review.Sep 22 2016, 3:24 AM
• jmatazzoni removed a project: Collab-Team-Q1-July-Sep-2016.Oct 4 2016, 10:54 PM
Restricted Application added a project: Collaboration-Team-Triage. · View Herald TranscriptOct 4 2016, 10:54 PM
gerritbot added a comment.Feb 23 2017, 6:55 PM

Change 339472 had a related patch set uploaded (by Catrope):
Store goodfaith scores in the ORES tables

https://gerrit.wikimedia.org/r/339472

gerritbot added a comment.Feb 24 2017, 12:04 AM

Change 339472 merged by jenkins-bot:
Store goodfaith scores in the ORES tables

https://gerrit.wikimedia.org/r/339472

Stashbot subscribed.Feb 24 2017, 12:26 AM

Mentioned in SAL (#wikimedia-operations) [2017-02-24T00:26:50Z] <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:339472|Store goodfaith scores in the ORES tables]] T137966 (duration: 00m 40s)

gerritbot added a comment.Feb 24 2017, 12:36 AM

Change 312166 abandoned by Catrope:
[WIP] Add goodfaith filtering

Reason:
Superseded by other commits that have since been merged

https://gerrit.wikimedia.org/r/312166

Catrope closed this task as Resolved.Feb 24 2017, 12:43 AM

Closing this since:

  • We are now populating goodfaith scores into the DB
  • We've decided how to represent this in the UI in the new RCFilters beta feature
  • We've decided not to put goodfaith-related features in the "old" ORES UI
Quiddity unsubscribed.Feb 24 2017, 1:23 AM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits