Page MenuHomePhabricator

[Analysis] Reference check concept validation (qualitative)
Open, Needs TriagePublic

Description

This task involves the work of analyzing how people qualitatively report their experience with the first iteration of reference Edit Check.

NOTE: the corresponding quantitative analysis will happen in T342404

Decisions to be made

  • 1. Will we make any fundamental changes to where and how the Reference Check is presented before investing more energy into refining and scaling the initial approach?

Learning objectives

  1. Motivation: Do Newcomers and Junior Contributors from SSA perceive Edit Check to be motivating, empowering, and supportive? Said another way: volunteers will not feel discouraged or unfairly punished by the feedback Edit Check presents.
  2. Auditability: Do Senior Contributors feel like they have sufficient ability to ensure the choices Edit Check presents to newcomers and Junior Contributors align with the broader project's expectations?

Research questions

FacetResearch QuestionMetric(s) for evaluation
MotivationDo Newcomers and Junior Contributors from SSA perceive Edit Check to be motivating, empowering, and supportive?TBD
AuditabilityDo Senior Contributors feel like they have sufficient ability to ensure the choices Edit Check presents to newcomers and Junior Contributors align with the broader project's policies and conventions?TBD

This task was inspired by the point User:Joe Roe raised on mediawiki.org.