Page MenuHomePhabricator

Mentorship + Personalized Praise: Arabic, Bangla, and Czech analysis
Closed, ResolvedPublic

Description

Analysis task

Spanish Wikipedia has Growth's Mentorship released to 50% of newcomers. English Wikipedia also has Mentorship released to only a percentage of new accounts created.
This gives us a unique opportunity to test the impact of mentorship.

Mentorship questions:
Are there any differences in activation between newcomers who receive mentorship and newcomers who don't? Does this differ if we only look at mainspace article editing vs. any namespace edit?
For editors who have already edited once, is there any differences in retention between newcomers who receive mentorship and newcomers who don't?
Are there any differences in revert rates between newcomers who receive mentorship and newcomers who don't?

Personalized praise questions:
Are mentees who are considered "praiseworthy" and have a mentor (and therefore might receive a personalize praise message) more likely to be retained than a mentee that is praiseworthy but does not have a mentor (and therefore not receiving praise).
Does a mentee's engagement (edit count) increase after receiving personalized praise from their mentor, compared to a similar editor who does not receive a message?

Background

Research shows that praise and encouragement from other users increases newcomer retention.
The personalized praise idea is part of a larger Growth team Positive Reinforcement effort.

Acceptance Criteria
  • Written summary of analysis for Arabic, Bangla, and Czech pilot wikis

Event Timeline

KStoller-WMF moved this task from Inbox to Sprint 1 (Growth Team) on the Growth-Team board.

A written summary of our findings have been published on the Positive reinforcement project page in the section "Personalized praise experiment results". The notebooks associated with this analysis have been uploaded to this Gitlab repository and carry the name of this phab task. Closing as resolved.