Maniphest T225964

[SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
Open, NormalPublic
Actions

Description

This is the master ticket for the work needed to build a tool that will suggest depicts tags based on image content as determined by a machine vision platform.

Initial High-level requirements:

A new Special page where suggested tags can be confirmed by users
Integration with new "middle-ware" that sits between WMF code and the machine vision API
Integration with notifications system to inform users when their uploads have been processed through the vision system and have tags ready for confirmation.

Related Objects
Search...

		Status	Assigned	Task
		Open	None	T225964 [SDC] Build a depicts tag suggestion tool that is powered by machine vision platforms
		Open	None	T226119 Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool
		Open	None	T227349 Deploy the MachineVision extension to production
		Resolved	Mholloway	T227348 Deploy MachineVision extension to the Beta Cluster
		Open	sbassett	T227346 Security readiness review for the MachineVision extension
		Resolved	Mholloway	T227347 Create a diagram of the machine vision middleware architecture
		Resolved	Marostegui	T227355 DBA review for the MachineVision extension
		Resolved	Mholloway	T227351 Define DB table schemas for MV depicts suggestions
		Open	Mholloway	T230813 Performance review for the MachineVision extension
		Resolved	Mholloway	T227353 Define the lifecycle for MV-generated depicts suggestion data
		Invalid	None	T227341 Define criteria for human editor verification of MV-generated metadata for purposes of model refinement
		Resolved	sbassett	T227591 Security Concept Review for the machine vision middleware project
		Resolved	Mholloway	T227342 Define criteria for human editor verification of MV-generated metadata for promotion to SDC
		Declined	None	T227339 Create a spec for the depicts suggestion response
		Resolved	Tgr	T228694 Design a system for recording votes on depicts suggestions
		Open	None	T229314 Decide where to store past labeling data
		Open	Miriam	T228440 Computer Vision Consultation from Research
		Resolved	Mhurd	T230836 Build prototype `machine assisted depicts tag suggestions` extension

Event Timeline

Ramsey-WMF created this task.Jun 17 2019, 5:44 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 17 2019, 5:44 PM

Ramsey-WMF added a project: SDC-Statements (Machine-vision-depicts).Jun 17 2019, 5:47 PM

JoeWalsh added a subtask: T226119: Build middleware to utilize machine vision API for structured data on commons depicts tag suggestion tool.Jun 19 2019, 5:23 PM

Ramsey-WMF triaged this task as Normal priority.Jun 25 2019, 3:22 PM

Ramsey-WMF moved this task from Untriaged to Next up on the Multimedia board.

Step-by-step instructions I used for dev environment setup:

https://gist.github.com/montehurd/d227af99fdb753d739d40b98644f16c2

Mholloway added a subscriber: Mholloway.Jul 4 2019, 3:03 PM

Miriam merged a task: T125273: Investigate the options available for creating and adding tags for Commons pictures.Jul 18 2019, 3:47 PM

Miriam added subscribers: leila, Capankajsmilyo, Steinsplitter and 2 others.

Ramsey-WMF moved this task from To Do to Doing on the Structured Data Engineering board.Aug 6 2019, 7:03 PM

Aklapper edited projects, added Structured-Data-Backlog; removed Multimedia.Aug 10 2019, 11:54 PM

Restricted Application added a project: Multimedia. · View Herald TranscriptAug 10 2019, 11:54 PM

Aklapper edited projects, added Structured-Data-Backlog (Current Work); removed Structured-Data-Backlog, Multimedia.Aug 10 2019, 11:57 PM

Miriam added subscribers: Miriam, Multichill.Aug 14 2019, 1:49 PM

Mholloway closed subtask T230836: Build prototype `machine assisted depicts tag suggestions` extension as Resolved.Aug 23 2019, 4:54 PM

Ramsey-WMF moved this task from To Do to Doing on the Structured-Data-Backlog (Current Work) board.Aug 26 2019, 3:46 PM

Ramsey-WMF moved this task from To Do to Doing on the Structured-Data-Team-Current-Work board.Fri, Sep 20, 7:03 PM