[EPIC] Run a successful manual scan with MediaModeration's ModerateExistingFiles maintenance script
Closed, DeclinedPublic
Actions

Assigned To

None

Authored By

	Madalina
	May 5 2023, 4:10 PM

Description

Motivation

As a user I want to be able to scan images for potential child abuse content so that the harmful material can be identified.

Acceptance criteria:

We are able to manually trigger a scan using php run.php ./extensions/MediaModeration/maintenance/ModerateExistingFiles.php
An error rate of less than 1% for images that are processed via the maintenance script
Images are checked against PhotoDNA
If suspicious content is found an email is sent to autoflaggedcontent@wikimedia.org

Related Objects
Search...

Status	Assigned	Task
Declined	None	T336069 [EPIC] Run a successful manual scan with MediaModeration's ModerateExistingFiles maintenance script
Declined	• ERayfield	T336699 Debug MediaModeration script
Invalid	• ERayfield	T336576 Modify script to take image from database and upload images directly to PhotoDNA
Resolved	• ERayfield	T336370 Document how to run and debug the maintenance script
Resolved	• ERayfield	T287511 Evaluate PhotoDNA MediaModeration failures
Resolved	• ERayfield	T336205 Debug Error: The given file could not be verified as an image
Invalid	None	T336206 Debug Error: Hash check request failed
Resolved	• JKieserman	T336207 Debug Error: 429 too many requests
Invalid	None	T336074 [ DEBUG ] fix or remove file hashing
Declined	• ERayfield	T319332 create program for image detection of CSE
Declined	kostajh	T339988 Throttle requests to PhotoDNA API to no more than 5 requests per second
Declined	None	T339991 Log scanning output
Declined	None	T339992 Ensure flagged content is emailed to the correct party
Declined	None	T339993 Improve tracking system for scans
Declined	None	T340029 Add comprehensive testing to the script
Declined	None	T340442 Track successes/failures in Statsd
Invalid	• ERayfield	T341221 Send one file at a time to PhotoDNA

Event Timeline

Madalina created this task.May 5 2023, 4:10 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 5 2023, 4:10 PM

kostajh subscribed.May 8 2023, 1:25 PM

Madalina added a project: MediaModeration.May 8 2023, 6:53 PM

Madalina removed a subscriber: MediaModeration.

Madalina renamed this task from [EPIC] Run a successful manual scan to [EPIC] Run a successful manual scan w/ Media Moderation.May 15 2023, 3:06 PM

• JKieserman removed a subtask: T336074: [ DEBUG ] fix or remove file hashing.May 15 2023, 8:02 PM

• JKieserman mentioned this in T262336: MediaModeration Productionizing.May 15 2023, 9:48 PM

• JKieserman added a subtask: T336576: Modify script to take image from database and upload images directly to PhotoDNA.

• JKieserman added a subtask: T336370: Document how to run and debug the maintenance script.

• JKieserman added a subtask: T287511: Evaluate PhotoDNA MediaModeration failures.May 15 2023, 9:50 PM

• JKieserman closed subtask T336699: Debug MediaModeration script as Declined.

• JKieserman added a subtask: T319332: create program for image detection of CSE.May 15 2023, 9:54 PM

MShilova_WMF moved this task from Active Epics to Kanban on the Trust and Safety Tools Team Backlog board.May 30 2023, 5:48 PM

MShilova_WMF edited projects, added Trust and Safety Tools Team Backlog (Kanban); removed Trust and Safety Tools Team Backlog.

MShilova_WMF moved this task from 🎬 Ready to Active Epics on the Trust and Safety Tools Team Backlog (Kanban) board.

MShilova_WMF moved this task from Kanban to Active Epics on the Trust and Safety Tools Team Backlog board.May 31 2023, 2:27 PM

MShilova_WMF edited projects, added Trust and Safety Tools Team Backlog; removed Trust and Safety Tools Team Backlog (Kanban).

kostajh renamed this task from [EPIC] Run a successful manual scan w/ Media Moderation to [EPIC] Run a successful manual scan with MediaModeration's ModerateExistingFiles maintenance script.Jun 26 2023, 12:09 PM

kostajh updated the task description. (Show Details)

Madalina closed subtask T336370: Document how to run and debug the maintenance script as Resolved.Jun 28 2023, 4:27 PM

Madalina closed subtask T287511: Evaluate PhotoDNA MediaModeration failures as Resolved.

• JKieserman changed the status of subtask T339992: Ensure flagged content is emailed to the correct party from Open to Stalled.Jul 5 2023, 1:43 PM

kostajh added a subtask: T341221: Send one file at a time to PhotoDNA.Jul 6 2023, 7:33 PM

• ERayfield closed subtask T341221: Send one file at a time to PhotoDNA as Invalid.Aug 14 2023, 5:17 PM

• ERayfield closed subtask T336576: Modify script to take image from database and upload images directly to PhotoDNA as Invalid.Aug 14 2023, 5:20 PM

Ladsgroup subscribed.Oct 15 2023, 7:23 PM