Page MenuHomePhabricator

Include NSFW likelihood scores or filter out images classified as likely NSFW from image caption edit suggestions
Closed, InvalidPublic

Description

Serving randomized image suggestions to users for editing runs the risk of serving an NSFW image (to an inappropriate user / in an inappropriate context).

When our NSFW image classification service (T214201) is productionized, incorporate it into the image suggestion algorithm and avoid serving suggestions above a reasonable (TBD) threshold.

Alternatively, we could simply include NSFW likelihood scores in the response, so that clients could choose how to handle them (say, by filtering out those above a certain score for a user who has not elected to receive them).

Event Timeline

Mholloway renamed this task from Filter out images classified as likely NSFW from edit suggestions to Include NSFW likelihood scores or filter out images classified as likely NSFW from edit suggestions.May 31 2019, 7:11 PM
Mholloway updated the task description. (Show Details)
Mholloway renamed this task from Include NSFW likelihood scores or filter out images classified as likely NSFW from edit suggestions to Include NSFW likelihood scores or filter out images classified as likely NSFW from image caption edit suggestions.Jul 5 2019, 4:16 PM
Mholloway added a project: MachineVision.
Jhernandez lowered the priority of this task from Medium to Low.Dec 11 2019, 4:54 PM