Page MenuHomePhabricator

Include NSFW likelihood scores or filter out images classified as likely NSFW from image caption edit suggestions
Open, NormalPublic

Description

Serving randomized image suggestions to users for editing runs the risk of serving an NSFW image (to an inappropriate user / in an inappropriate context).

When our NSFW image classification service (T214201) is productionized, incorporate it into the image suggestion algorithm and avoid serving suggestions above a reasonable (TBD) threshold.

Alternatively, we could simply include NSFW likelihood scores in the response, so that clients could choose how to handle them (say, by filtering out those above a certain score for a user who has not elected to receive them).

Event Timeline

Mholloway triaged this task as Normal priority.May 31 2019, 7:06 PM
Mholloway created this task.
Mholloway updated the task description. (Show Details)May 31 2019, 7:08 PM
Mholloway renamed this task from Filter out images classified as likely NSFW from edit suggestions to Include NSFW likelihood scores or filter out images classified as likely NSFW from edit suggestions.May 31 2019, 7:11 PM
Mholloway updated the task description. (Show Details)
Mholloway renamed this task from Include NSFW likelihood scores or filter out images classified as likely NSFW from edit suggestions to Include NSFW likelihood scores or filter out images classified as likely NSFW from image caption edit suggestions.Jul 5 2019, 4:16 PM
Mholloway added a project: Machine vision.
Mholloway moved this task from Backlog to NSFW scoring on the Machine vision board.Jul 5 2019, 4:19 PM
Mholloway moved this task from NSFW scoring to Backlog on the Machine vision board.Aug 1 2019, 8:24 PM