Page MenuHomePhabricator

📊 Filter image suggestions detected as "placeholder images"
Closed, ResolvedPublic3 Estimated Story Points

Description

Context

The current algo implementation occasionally suggests placeholder images instead of actual content.
As a consumer of the API I would like to receive suggestions only for actual content.

This task follows from the investigation at
https://phabricator.wikimedia.org/T277828.

Acceptance Criteria
  • As a user of the Image Suggestion API, when I make a request for image suggestions, I expect that all images detected as a "placeholder image" have been filtered out
  • A static list of "placeholder images" has been generated and stored in HDFS
  • The algorithm notebook has been updated to filter out "placeholder images"

Notes

  • Data has been generated for the 2021-03 snapshot.
  • We won't be able to provide unit tests, but integration tests will be coordinated with research

Event Timeline

gmodena renamed this task from [Placeholder] Filter image suggestions detected as "placeholder images" to Filter image suggestions detected as "placeholder images".Apr 6 2021, 5:49 PM
gmodena updated the task description. (Show Details)
gmodena set the point value for this task to 3.
gmodena renamed this task from Filter image suggestions detected as "placeholder images" to 📊 Filter image suggestions detected as "placeholder images".Apr 6 2021, 6:13 PM
gmodena assigned this task to Clarakosi.

The algorithm notebook and pipeline have been updated to filter out placeholder images using @AikoChou changes.

@Miriam's validation query from (T277828#6957015) was also rerun to show the percentage of placeholder images being suggested per wiki after the changes. Something to note: the total number of suggestions has not changed.

Percentage of placeholder images per language

enwiki: 0.02%
arwiki: 0.00%
kowiki: 0.01%
cswiki: 0.00%
viwiki: 0.00%
frwiki: 0.00%
fawiki: 0.02%
ptwiki: 0.04%
ruwiki: 0.00%
trwiki: 0.00%
plwiki: 0.00%
hewiki: 0.00%
svwiki: 0.00%
ukwiki: 0.00%
huwiki: 0.00%
hywiki: 0.00%
srwiki: 0.02%
euwiki: 0.00%
arzwiki: 0.00%
cebwiki: 0.00%
dewiki: 0.01%
bnwiki: 0.00%