This is the second round of evaluation of the image recommendation algorithm. Per T256081#6474174, this version is very simple: it only suggests images if they are attached to the article's Wikidata item or are in the Commons category attached to the Wikidata item. We are going to evaluate these the same way as we did in T260857: Image suggestion evaluation August 2020.
- enwiki: @MMiller_WMF
- frwiki: @Trizek-WMF & @Dyolf77_WMF
- arwiki: @Dyolf77_WMF
- viwiki: @PPham
- kowiki: @revi
- cswiki: @Urbanecm_WMF
I put the files in tabs in this spreadsheet: https://docs.google.com/spreadsheets/d/1gk_3tPhDP49AwZQJj0Mcz4AOq1_054OGJHPj-Q-qEkw/edit#gid=253656325. We will evaluate the first 50 articles in each list. I sorted the articles randomly so we are evaluating a representative group.
We'll classify the "top. image" into these categories, along with explanatory comments where useful. NOTE: there is an additional classification, for if the article should not even have an image.
Classification | Explanation |
2 | Great match for the article, illustrating the thing that is the title of the article; e.g. the article is "Food" and it is an image of food. |
1 | Good match, but difficult to confirm for the article unless the user has some context, and would need a good caption; e.g. the article is "Food" and it is an image of a famous chef. |
0 | Not a fit for the article at all; e.g. the article is "Food" and the image is a car. |
-1 | Image is correct for the subject, but does not match the local culture; e.g. the article is "Food" and the image is a specific food from a specific culture that is not recognizable in the local culture. |
-2 | Misleading image that a newcomer could accidentally think is correct; e.g. the article is "Taco" and the image is a burrito. |
-3 | Page should not have an image, e.g. disambiguation pages, lists, or "given name" articles. |