Page MenuHomePhabricator

Investigate computer vision image classification and description tools for shadow tags and search descriptions
Open, NormalPublic

Description

While automated descriptions are not yet of a quality that can replace human generated ones, they may have a logical place for search or related content scenarios. Using machine generated descriptions, and tags to inform search results and related content results could benefit users even if they are not surfaced to users directly.

Possible resources
http://deeplearning.cs.toronto.edu/i2t
https://github.com/Visu4link/Pastec

Event Timeline

Jaredzimmerman-WMF raised the priority of this task from to Normal.
Jaredzimmerman-WMF updated the task description. (Show Details)
Jaredzimmerman-WMF changed Security from none to None.

Even if the description is not usable directly, this could be also interesting to suggest categories for the user to add.

Tgr added a subscriber: Tgr.EditedDec 5 2014, 8:27 PM

Face detection could be interesting when combined with T58666, to invite people to add annotations.

Tgr added a comment.Dec 5 2014, 8:44 PM

http://www.pastec.io/ claims to have a database built from Commons images, might be interesting to test.

Tgr added a comment.Dec 5 2014, 8:57 PM

Might be also interesting for visual captchas (T64960) although using a publicly available algorithm is always a weakness there.

Jdforrester-WMF moved this task from Untriaged to Backlog on the Multimedia board.Sep 4 2015, 6:30 PM
Restricted Application added a project: Wikidata. · View Herald TranscriptSep 4 2015, 6:30 PM
Restricted Application added a subscriber: Matanya. · View Herald Transcript
Lydia_Pintscher moved this task from incoming to monitoring on the Wikidata board.Sep 5 2015, 9:39 AM
Ramsey-WMF moved this task from Backlog to Stories on the SDC General board.Nov 3 2017, 8:35 PM
Puik added a subscriber: Puik.May 30 2018, 11:32 AM

Seems related to https://commons.wikimedia.org/wiki/User:Multichill/Using_OpenCV_to_categorize_files (see talk page too). Good hackathon project for Prague?