[SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
Closed, ResolvedPublic
Actions

Description

This is the master ticket for the work needed to build a tool that will suggest depicts tags based on image content as determined by a machine vision platform.

Initial High-level requirements:

A new Special page where suggested tags can be confirmed by users
Integration with new "middle-ware" that sits between WMF code and the machine vision API
Integration with notifications system to inform users when their uploads have been processed through the vision system and have tags ready for confirmation.

Related Objects
Search...

Status	Assigned	Task
Resolved	Ramsey-WMF	T225964 [SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
Resolved	Mholloway	T226119 Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool
Resolved	Mholloway	T227349 Deploy the MachineVision extension to production
Resolved	Mholloway	T227348 Deploy MachineVision extension to the Beta Cluster
Resolved	sbassett	T227346 Security readiness review for the MachineVision extension
Resolved	Mholloway	T227347 Create a diagram of the machine vision middleware architecture
Resolved	Marostegui	T227355 DBA review for the MachineVision extension
Resolved	Mholloway	T227351 Define DB table schemas for MV depicts suggestions
Resolved	Krinkle	T230813 Performance review for the MachineVision extension
Resolved	Mholloway	T240210 Fallback text for non-JS-supporting clients on Special:SuggestedTags
Open	None	T242662 "machinevision-machineaidedtagging-intro" message should not refer to production interwiki codes
Resolved	Ramsey-WMF	T242667 Reduce flash of empty page and hoisted footer when loading Special:SuggestedTags (FOUC)
Resolved	Mholloway	T236797 How should the MachineVision extension interact with external APIs from production?
Resolved	Mholloway	T236426 Configure Google Cloud Vision credentials in production
Resolved	Mholloway	T236843 Add HTTP proxy support to the MachineVision extension
Resolved	Mholloway	T237596 Add MachineVision dependencies to vendor
Declined	Reedy	T237588 Security review for MachineVision libraries
Resolved	Mholloway	T227353 Define the lifecycle for MV-generated depicts suggestion data
Invalid	None	T227341 Define criteria for human editor verification of MV-generated metadata for purposes of model refinement
Resolved	sbassett	T227591 Security Concept Review for the machine vision middleware project
Resolved	Mholloway	T227342 Define criteria for human editor verification of MV-generated metadata for promotion to SDC
Declined	None	T227339 Create a spec for the depicts suggestion response
Resolved	Tgr	T228694 Design a system for recording votes on depicts suggestions
Open	None	T229314 Decide where to store past labeling data
Resolved	Miriam	T228440 Computer Vision Consultation from Research
Resolved	Mhurd	T230836 Build prototype `machine assisted depicts tag suggestions` extension