Page MenuHomePhabricator

Design Exploration: Get Started Notification(s)
Closed, ResolvedPublic

Description

User story & summary:

As a newcomer, I want to receive a well-timed and engaging notification that guides me toward my first edit, so I can quickly understand what to do next and feel encouraged to contribute. By receiving clear guidance at the right moment, I will be more likely to take my first editing step and continue participating in Wikipedia.

Background & research:

Hypothesis: If new accounts that have not yet edited receive a supportive notification* with a Suggested Edit recommendation within 24 hours of creating an account, then they will be more likely to activate constructively.
*An Echo notification and an email if the account has an associated email address.

Supporting Data & Insights:

  • The “Get Started” notification has already been shown to increase newcomer editing when sent at 48 hours after account creation (1). This suggests that well-timed interventions can positively impact newcomer activation. By sending the notification earlier, we may further improve activation rates by reaching users while their interest is still high.
  • Prior studies show that positive reinforcement, such as the "Thanks" feature, leads to increased editor engagement (2). This suggests that notifications framed as encouragement rather than just instructions may yield better results.
Design Exploration Considerations & Questions

Timing & Frequency

  • What is the optimal time to send the first "Get Started" notification? Should it be immediate, within a few hours, or within the first day?
  • Should we consider sending additional follow-up notifications if the newcomer does not take action?
  • How can we balance engaging newcomers without being overwhelming or annoying?

Messaging & Content

  • How can we improve the copy to make it more engaging, welcoming, and action-oriented?
  • Should the notification include a direct Suggested Edit recommendation, or should it provide more general guidance first?
  • Should the tone be instructional, encouraging, or gamified (e.g., "Your first edit is waiting for you!")?

Design & Delivery

  • How should the notification be structured to maximize readability and engagement?
  • Should we explore improvements to how the notification appears in Echo?
  • Should we optimize the email version of the notification for better engagement?
  • Would a more visually engaging format increase the likelihood of engagement?

Iterative Approach

  • What would a minimal viable product (MVP) version of this experiment look like?
  • If successful, what additional improvements could be explored (e.g., personalized task recommendations, reminders, or milestone-based encouragement messages)?
Acceptance Criteria:

Event Timeline

KStoller-WMF moved this task from Inbox to Backlog on the Growth-Team board.
KStoller-WMF raised the priority of this task from Medium to High.Mar 26 2025, 4:22 PM
  • Research past Growth experiments related to newcomer notifications and engagement.

from https://www.mediawiki.org/wiki/Growth/Positive_reinforcement#Levelling_up_experiment_results

[...] two notifications sent to newcomers 48 hours after registration. If the newcomer has not made any suggested edits they get the "Get started" notification [...]

For the "Get started" notification, we find that this is sent to the vast majority of newcomers as making suggested edits is fairly uncommon. In our dataset, more than 97% of newcomers got this notification. We find that the notification leads to a significant increase in newcomer activity in the week following the notifications being sent. Newcomers are more likely to return and make an edit, which also increases the average number of edits made during that week. We also find that this effect is lower for those who registered on mobile web, and reduced or negative for highly active newcomers. Based on this, we decided to introduce a threshold so that those who make ten or more edits will not receive the notification (T342819).

main takeaway: the get started notification significantly increases newcomer activity in the following week.


from https://docs.google.com/presentation/d/1L6DOn6nY8aTR0GgJNSYML4E4H4v0Za1E6ji3WsA7X9M/edit?slide=id.g8c685784b9_0_39#slide=id.g8c685784b9_0_39 and https://docs.google.com/presentation/d/1hvDHNTLZ9Lr7CjHqtYOUjSU2VZtN5AtTfh2Xnstu56s/edit?slide=id.g1aab7ba12b_0_24#slide=id.g1aab7ba12b_0_24

main takeaway: having stronger affordance increases interaction with suggested edits, but that does not lead to more users editing. while onboarding may lead to more users editing.

bonus: this is not listed as acceptance criteria but we conducted an internal desk research on newcomers motivation and activation

full notes available here https://docs.google.com/document/d/1FWMBvaVVoa7ljFpk2_WFiXyRyYaJUYWXT4YYsurGaac/edit?tab=t.0#bookmark=id.2qrrla2yq6oy

main takeaways:

  • wikipedia users started editing because of curiosity in the editability of wikipedia [1]
  • research on online communities[2] indicates people are more likely to start participating if they see that their work will be seen, and in turn engender a sense of connection. quoting:
    • Impact: They believe their effort is important to the group’s performance
    • Identity/Recognition: They believe their contributions to the group are identifiable
    • Social: They like the group they are working with.
  • Non-editor respondents in Wikipedia surveys cite main reasons for not editing because they feel insufficiently knowledgeable [3]
  • Visual details and animations are an important part of the execution and delivery of positive reinforcement messages. The “fun factor” is also part of user motivations from users surveyed on-wiki [4]

[1]: https://docs.google.com/presentation/d/1L6DOn6nY8aTR0GgJNSYML4E4H4v0Za1E6ji3WsA7X9M/edit?slide=id.g8abf83970e_0_0#slide=id.g8abf83970e_0_0
[2]: https://www.sciencedirect.com/science/article/pii/S107158191730126X
[3]: https://upload.wikimedia.org/wikipedia/commons/6/6a/Wikimedia_Foundation_and_Reboot_New_Readers_Research_-_Nigeria_%26_India_Highlights_-_July_2016.pdf
[4]: https://docs.google.com/presentation/d/1Cft30eYa0MBAgbLr__XRNXPrb5VtNdE7eHUIzeufZDI/edit?usp=sharing

AAlhazwani-WMF changed the task status from Open to In Progress.May 23 2025, 1:16 PM
  • Draft requirements for T393722: Get Started Notification Experiment [Phase 1] - Define the timing and frequency strategy for sending the notification(s) & draft copy changes.

timing and frequency: send 1x notification 20hr after account creation
copy changes:

  • main text: "Curious about editing Wikipedia? Your knowledge joins a community reaching millions."
  • button label: "Try suggested edits" (as in prod)

image.png (1×750 px, 133 KB)

I’ve removed the second iteration design work from this task’s acceptance criteria. Amin and I agreed that it makes sense to prioritize other work for now, and revisit the second iteration as part of next fiscal year’s progression system hypothesis. Ideally, we’ll also have experiment results by then to help inform the next round of iteration.