Maniphest T362610

Automoderator pilot deployment metrics (idwiki)
Open, Needs TriagePublic
Actions

Assigned To

Authored By

	KCVelaga_WMF
	Apr 16 2024, 7:19 AM

Tags

Referenced Files

None

Subscribers

• Samwalton9-WMF

Description

Key metrics to be tracked:

Volume: Number of reverts (split: anonymous, newcomers, non-newcomers)
False positive: Revert rate of AM reverts by non-new editors
Pageviews of vandalized content
Proportion of edits reverted by human/AM/tool
False negatives: average risk of score of edits reverted by human patrollers

A Superset dashboard can be created for most of the metrics, and rest can be reported on wiki.

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T358228 Deploy AutoModerator as a pilot on one Wikimedia project
		Open		KCVelaga_WMF	T362610 Automoderator pilot deployment metrics (idwiki)

Event Timeline

KCVelaga_WMF created this task.Apr 16 2024, 7:19 AM

Restricted Application added a project: Moderator-Tools-Team. · View Herald TranscriptApr 16 2024, 7:19 AM

KCVelaga_WMF claimed this task.Apr 16 2024, 7:20 AM

KCVelaga_WMF added a parent task: T358228: Deploy AutoModerator as a pilot on one Wikimedia project.

KCVelaga_WMF updated the task description. (Show Details)

KCVelaga_WMF moved this task from Triage to Current Quarter on the Product-Analytics board.

• Samwalton9-WMF moved this task from Inbox to Product backlog on the Moderator-Tools-Team board.Apr 16 2024, 8:13 AM

• Samwalton9-WMF moved this task from Backlog to Data/Research on the Automoderator board.Apr 17 2024, 9:00 AM