Page MenuHomePhabricator
Create Task
Maniphest T225964

[SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
Closed, ResolvedPublic
Actions

Description

This is the master ticket for the work needed to build a tool that will suggest depicts tags based on image content as determined by a machine vision platform.

Initial High-level requirements:

  • A new Special page where suggested tags can be confirmed by users
  • Integration with new "middle-ware" that sits between WMF code and the machine vision API
  • Integration with notifications system to inform users when their uploads have been processed through the vision system and have tags ready for confirmation.

Related Objects
Search...

StatusSubtypeAssignedTask
 ResolvedRamsey-WMFT225964 [SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
 ResolvedMhollowayT226119 Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool
 ResolvedMhollowayT227349 Deploy the MachineVision extension to production
 ResolvedMhollowayT227348 Deploy MachineVision extension to the Beta Cluster
 ResolvedsbassettT227346 Security readiness review for the MachineVision extension
 ResolvedMhollowayT227347 Create a diagram of the machine vision middleware architecture
 ResolvedMarosteguiT227355 DBA review for the MachineVision extension
 ResolvedMhollowayT227351 Define DB table schemas for MV depicts suggestions
 ResolvedKrinkleT230813 Performance review for the MachineVision extension
 ResolvedMhollowayT240210 Fallback text for non-JS-supporting clients on Special:SuggestedTags
 ResolvedNoneT242662 "machinevision-machineaidedtagging-intro" message should not refer to production interwiki codes
 ResolvedRamsey-WMFT242667 Reduce flash of empty page and hoisted footer when loading Special:SuggestedTags (FOUC)
 ResolvedMhollowayT236797 How should the MachineVision extension interact with external APIs from production?
 ResolvedMhollowayT236426 Configure Google Cloud Vision credentials in production
 ResolvedMhollowayT236843 Add HTTP proxy support to the MachineVision extension
 ResolvedMhollowayT237596 Add MachineVision dependencies to vendor
 DeclinedReedyT237588 Security review for MachineVision libraries
 ResolvedMhollowayT227353 Define the lifecycle for MV-generated depicts suggestion data
 InvalidNoneT227341 Define criteria for human editor verification of MV-generated metadata for purposes of model refinement
 ResolvedsbassettT227591 Security Concept Review for the machine vision middleware project
 ResolvedMhollowayT227342 Define criteria for human editor verification of MV-generated metadata for promotion to SDC
 DeclinedNoneT227339 Create a spec for the depicts suggestion response
 ResolvedTgrT228694 Design a system for recording votes on depicts suggestions
 OpenNoneT229314 Decide where to store past labeling data
 ResolvedMiriamT228440 Computer Vision Consultation from Research
 ResolvedMhurdT230836 Build prototype `machine assisted depicts tag suggestions` extension

Event Timeline

Ramsey-WMF created this task.Jun 17 2019, 5:44 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 17 2019, 5:44 PM
Ramsey-WMF added a project: SDC-Statements (Machine-vision-depicts).Jun 17 2019, 5:47 PM
JoeWalsh added a subtask: T226119: Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool.Jun 19 2019, 5:23 PM
Ramsey-WMF triaged this task as Medium priority.Jun 25 2019, 3:22 PM
Ramsey-WMF moved this task from Untriaged to Next up on the Multimedia board.
Mhurd added a subscriber: Mhurd.Jun 25 2019, 9:17 PM

Step-by-step instructions I used for dev environment setup:

https://gist.github.com/montehurd/d227af99fdb753d739d40b98644f16c2

Mholloway added a subscriber: Mholloway.Jul 4 2019, 3:03 PM
Miriam merged a task: T125273: Investigate the options available for creating and adding tags for Commons pictures.Jul 18 2019, 3:47 PM
Miriam added subscribers: leila, Capankajsmilyo, Steinsplitter and 2 others.
Ramsey-WMF moved this task from To Do to Doing on the Structured Data Engineering board.Aug 6 2019, 7:03 PM
Aklapper edited projects, added Structured-Data-Backlog; removed Multimedia.Aug 10 2019, 11:54 PM
Restricted Application added a project: Multimedia. · View Herald TranscriptAug 10 2019, 11:54 PM
Aklapper edited projects, added Structured-Data-Backlog (Current Work); removed Structured-Data-Backlog, Multimedia.Aug 10 2019, 11:57 PM
Miriam added subscribers: Miriam, Multichill.Aug 14 2019, 1:49 PM
Mholloway closed subtask T230836: Build prototype `machine assisted depicts tag suggestions` extension as Resolved.Aug 23 2019, 4:54 PM
Ramsey-WMF moved this task from Incoming to Doing on the Structured-Data-Backlog (Current Work) board.Aug 26 2019, 3:46 PM
Ramsey-WMF moved this task from To Do to Doing on the Structured-Data-Team-Current-Work board.Sep 20 2019, 7:03 PM
RhinosF1 added a subscriber: RhinosF1.Oct 30 2019, 5:26 AM
Ramsey-WMF closed subtask T228440: Computer Vision Consultation from Research as Resolved.Dec 16 2019, 11:23 PM
Ramsey-WMF closed this task as Resolved.Dec 17 2019, 5:42 PM
Ramsey-WMF claimed this task.

We did it!

Mholloway closed subtask T226119: Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool as Resolved.Feb 12 2020, 5:15 PM
Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL