Page MenuHomePhabricator

Give readers guidance on content "trustworthiness"
Open, LowestPublic

Description

A top concern of consumers of Wikipedia is trust. There are concerns that content is biased, inaccurate, absurd, outdated or incomplete. This is a parent task to identify a means to provide meaningful guidance to a user that will help them evaluate how sure they can be that the content is something they could act on, quote publicly, guide further study etc.

The most prominent idea here is a trust signal or score.
One is a "trust score" for either a content chunk, revision or article, similar to or based off of WikiTrust, which scores content based on an implicit review process -- content contributed by trustworthy editors is scored highly. Content contributed by less trustworthy editors is scored poorly at first, but as subsequent edits happen to an article (especially edits by Trustworthy editors), the content's score grows.

More on Wikitrust: This is not an a machine learning approach. It is content analysis. It is extremely computationally intensive.

Event Timeline

Halfak triaged this task as Lowest priority.Nov 10 2016, 3:07 PM
Halfak updated the task description. (Show Details)
Halfak moved this task from Unsorted to Ideas on the Machine-Learning-Team board.
Halfak added a subscriber: JKatzWMF.

@JKatzWMF, I think you'd brought up the idea of getting trustworthiness scores from ORES. Is that right? If so, I think here is where we'll want to continue that conversation.

@Halfak Thanks! I will reword this a bit to be a little more explicitly value-driven, because I don't think we know yet what the most valuable signal for scoring validity is. I think we should probably start one level up: with what users worry about when they worry about Wikipedia "accuracy" and then identify the most pragmatic signals to address those concerns.

JKatzWMF renamed this task from WikiTrust style scoring to Give readers guidance on content "trustworthiness".Nov 10 2016, 5:39 PM
JKatzWMF updated the task description. (Show Details)