Page MenuHomePhabricator

[Design] User experience for Model Testing Tool
Closed, ResolvedPublic

Description

Background

Prior to designing Automoderator, we want to make sure that the Moderator Community likes and wants Automoderator's machine learning (ML) model, known as Revert Risk. We will be designing a lightweight tool for the community to test Revert Risk and we hope for positive feedback.

Goals

Design a lightweight tool that will enable the community to test, understand, and approve of Revert Risk and help us (the ModTools team) learn as much as possible before designing Automoderator

Links

Event Timeline

Currently working on the following:

  1. seeing if we can increase visibility into how the model thinks and how the bot behaves
  2. seeing if we can incorporate an intuitive pathway for moderators to talk to one another about Automoderator
  3. Run a moderated test of the spreadsheet with @Quiddity and incorporate his feedback
  4. Share the spreadsheet in design review and incorporate feedback from the design team