Page MenuHomePhabricator
Create Task
Maniphest T267674

[Epic] Build Media Matching API for bots/scripts
Closed, ResolvedPublic
Actions

Description

User story: As a bot writer on wikis, I want a reliable and robust API for matching highly relevant multimedia/images to specific articles, so that I can accurately add files (mostly images) to articles that my bots create or edit.

Acceptance Criteria:

  • Bots can call the Image Recommendations API to get a list of unillustrated articles on a given wiki and their image matches, both from the ImageMatching Algorithm and from MediaSearch
  • Bots can decide how many of the given matches to add to an article
  • Bots can call the Image Recommendations API to get a list of image matches for a given article from both the ImageMatching Algorithm and MediaSearch
  • The API returns a "confidence score" value in the API that bots can use to estimate how relevant/accurate the returned images are and decide which to add

During development, please test the following:

  • Use a bot on beta wiki to test the above features

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedcchenT261343 Dashboard of multimedia usage on the Wikipedias
 ResolvedCBogenT267674 [Epic] Build Media Matching API for bots/scripts
 ResolvedCparleT273062 [L] Create tool to manually test image recommendations POC results
 ResolvedCBogenT273092 Manually test image recommendations POC results
 ResolvedCparleT281893 Repopulate testing tool after removing new "instance of" categories
 ResolvedCparleT269852 [Epic] Interpret image search signal results
 ResolvedCparleT271799 [L] Implement new search profile(s) based on image search signal results
ResolvedCparleT272710 Investigate whether the probability-of-an-image-being-good score is useful as a confidence score
 ResolvedAikoChouT274225 Multivariate logistic regression on search scores
 ResolvedCparleT271801 Create mechanism for comparing search profiles using labelled data
 ResolvedCparleT271803 [Epic] Improve mediasearch by using labelled data to create a model using elasticsearch learning-to-rank
 ResolvedCparleT271806 Create elasticsearch featureset to get scores for each component in a mediasearch
 ResolvedAnneTT273882 [M] Estimate how many unillustrated articles on Cebuano and Arabic wikis would have matches in MediaSearch
DeclinedcchenT265771 Measure how multimedia content is added to Wikipedia articles
 ResolvedmatthiasmullieT266067 [L] Create edit tags to measure multimedia edits to Wikipedia articles
 DeclinedNoneT282216 [SPIKE] Add edit tags for each type of media for Hashtags tool
 ResolvedcchenT275888 Measure success of Media Matching bots
 ResolvedBUG REPORTmatthiasmullieT286362 [XL] mw-add-media and mw-remove-media tags are added to edits without changes in media
 DeclinedNoneT276135 Create a test bot to add images on a beta wiki

Event Timeline

• Ramsey-WMF created this task.Nov 10 2020, 7:06 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptNov 10 2020, 7:06 PM
• Ramsey-WMF added a project: SDAW-MediaSearch.Nov 10 2020, 7:24 PM
• Ramsey-WMF updated the task description. (Show Details)Nov 10 2020, 10:06 PM
Lsj added a subscriber: Lsj.Nov 12 2020, 10:08 AM
Cparle added a subscriber: Cparle.Nov 16 2020, 5:46 PM
MMiller_WMF added subscribers: • sdkim, WDoranWMF, MMiller_WMF.Dec 3 2020, 10:09 PM

@WDoranWMF @sdkim -- here's a task where the Structured Data team records what they want to surface to their bot writers for their use case. I wanted to point this out to ask whether it seems like this should somehow be part of the "Task API".

• JKatzWMF added a project: Tech-Product API Roadmap.Dec 4 2020, 10:38 PM
CBogen edited projects, added Structured-Data-Backlog (Current Work); removed Structured-Data-Backlog.Dec 7 2020, 4:55 PM
CBogen added a project: Image-Suggestions.Dec 9 2020, 7:50 PM
CBogen moved this task from To Do to Epics on the Image-Suggestions board.Dec 9 2020, 10:08 PM
CBogen moved this task from Incoming to Epics on the Structured-Data-Backlog (Current Work) board.Jan 14 2021, 10:32 PM
CBogen moved this task from Backlog to MediaSearch-ImageRecs on the SDAW-MediaSearch board.Jan 27 2021, 2:12 PM
CBogen edited projects, added SDAW-MediaSearch (MediaSearch-ImageRecs); removed SDAW-MediaSearch.
CBogen added a subtask: T273062: [L] Create tool to manually test image recommendations POC results.
MMiller_WMF mentioned this in T254768: [EPIC] Image recommendations proof-of-concept phase.Jan 28 2021, 8:16 PM
CBogen added a subtask: T273092: Manually test image recommendations POC results.Jan 28 2021, 9:03 PM
CBogen added a subtask: T272710: Investigate whether the probability-of-an-image-being-good score is useful as a confidence score.
CBogen added a subtask: T269852: [Epic] Interpret image search signal results.
CBogen removed a subtask: T272710: Investigate whether the probability-of-an-image-being-good score is useful as a confidence score.
• Jar added a subscriber: • Jar.Jan 30 2021, 8:25 AM
Restricted Application added a subscriber: alaa. · View Herald TranscriptJan 30 2021, 8:25 AM
CBogen added a subtask: T273882: [M] Estimate how many unillustrated articles on Cebuano and Arabic wikis would have matches in MediaSearch .Feb 4 2021, 2:11 PM
CBogen added a subtask: T265771: Measure how multimedia content is added to Wikipedia articles.Feb 10 2021, 2:24 PM
CBogen added a subtask: T275888: Measure success of Media Matching bots.Feb 26 2021, 3:15 PM
CBogen updated the task description. (Show Details)Mar 1 2021, 6:12 PM
CBogen added a subtask: T276135: Create a test bot to add images on a beta wiki.Mar 1 2021, 6:17 PM
CBogen closed subtask T276135: Create a test bot to add images on a beta wiki as Declined.Mar 8 2021, 5:36 PM
CBogen closed subtask T273882: [M] Estimate how many unillustrated articles on Cebuano and Arabic wikis would have matches in MediaSearch as Resolved.Mar 30 2021, 3:19 PM
CBogen closed subtask T269852: [Epic] Interpret image search signal results as Resolved.Apr 23 2021, 2:28 PM
CBogen closed subtask T273062: [L] Create tool to manually test image recommendations POC results as Resolved.May 11 2021, 3:25 PM
CBogen closed subtask T273092: Manually test image recommendations POC results as Resolved.May 24 2021, 8:46 PM
cchen closed subtask T275888: Measure success of Media Matching bots as Resolved.Oct 8 2021, 10:40 AM
nettrom_WMF changed the status of subtask T265771: Measure how multimedia content is added to Wikipedia articles from Open to Stalled.Oct 25 2021, 4:40 PM
Cparle added a subscriber: CBogen.Jan 19 2022, 11:19 AM

I think that we're moving away from having this data added by bots, are we? Is this epic still relevant @CBogen ?

CBogen closed this task as Resolved.Jan 19 2022, 2:07 PM
CBogen claimed this task.
In T267674#7631775, @Cparle wrote:

I think that we're moving away from having this data added by bots, are we? Is this epic still relevant @CBogen ?

I agree we can close this. We're still waiting on the final report from Lsj about how the Cebuano bot went, but all of the dev work related to this is complete and we aren't planning to run any more bots.

CBogen reopened subtask T275888: Measure success of Media Matching bots as Open.Jan 20 2022, 4:58 PM
CBogen closed subtask T275888: Measure success of Media Matching bots as Resolved.Feb 14 2022, 5:37 PM
CBogen reopened subtask T275888: Measure success of Media Matching bots as Open.May 10 2022, 2:57 PM
CBogen closed subtask T275888: Measure success of Media Matching bots as Resolved.Jun 20 2022, 3:29 PM
CBogen closed subtask T265771: Measure how multimedia content is added to Wikipedia articles as Declined.Nov 3 2022, 2:36 PM
Meno25 removed a subscriber: • Jar.Jan 14 2023, 10:29 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL