Page MenuHomePhabricator

Include NSFW likelihood scores or filter out images classified as likely NSFW from image caption edit suggestions
Open, LowPublic

Description

Serving randomized image suggestions to users for editing runs the risk of serving an NSFW image (to an inappropriate user / in an inappropriate context).

When our NSFW image classification service (T214201) is productionized, incorporate it into the image suggestion algorithm and avoid serving suggestions above a reasonable (TBD) threshold.

Alternatively, we could simply include NSFW likelihood scores in the response, so that clients could choose how to handle them (say, by filtering out those above a certain score for a user who has not elected to receive them).

Event Timeline

Mholloway triaged this task as Medium priority.May 31 2019, 7:06 PM
Mholloway created this task.
Mholloway updated the task description. (Show Details)May 31 2019, 7:08 PM
Mholloway renamed this task from Filter out images classified as likely NSFW from edit suggestions to Include NSFW likelihood scores or filter out images classified as likely NSFW from edit suggestions.May 31 2019, 7:11 PM
Mholloway updated the task description. (Show Details)
Mholloway renamed this task from Include NSFW likelihood scores or filter out images classified as likely NSFW from edit suggestions to Include NSFW likelihood scores or filter out images classified as likely NSFW from image caption edit suggestions.Jul 5 2019, 4:16 PM
Mholloway added a project: MachineVision.
Mholloway moved this task from Backlog to NSFW scoring on the MachineVision board.Jul 5 2019, 4:19 PM
Mholloway moved this task from NSFW scoring to Backlog on the MachineVision board.Aug 1 2019, 8:24 PM
Jhernandez lowered the priority of this task from Medium to Low.Dec 11 2019, 4:54 PM
Jhernandez moved this task from Upcoming to Backlog on the Product-Infrastructure-Team-Backlog board.