Page MenuHomePhabricator

Experimentation capabilities for logged-out users
Open, LowPublic

Description

Request Status: New Request
Request Type: project support request
Related OKRs: https://docs.google.com/document/d/1mnyChikwOUF7_m_fWHKiLdLYex8T-ObAwtewdaNB_4U/edit, objective 1 and 2. In particular, measuring increased retention among readers.

Objective 2: New readers from five medium-sized or large emerging market wikis will return to Wikipedia more frequently as their main home for learning and reference due to direct exposure to content that is interesting, engaging, and catered on their needs or the needs of their communities, becoming casual readers through the process

KR 2.1: Increased retention for new readers across partner wikis. Potentially proxied by:
KR 2.2: Increases in session length and overall pageview increase across partner communities
KR 2.3: Increase engagement per page (Proxied by 10% increase in current total clicks to other pages outside of blue links)
KR 2.4: Creating a recommendation system that is flexible and configurable enough that it is accepted by the community in 5 medium-sized or large emerging wikis

Request Title:Provide experimentation capabilities for logged-out users

  • Request Description: Currently it is impossible or prohibitively difficult to run controlled experiments on logged-out users, who are the large majority of our users. Currently, logged-out users (mostly readers) comprise 99.98% of our overall traffic. In the past we have often tested on logged-in users only and used these tests as proxies for logged-out user traffic. However, we have proof that the behavior of readers varies greatly from the behavior of editors, rendering these proxies to be insufficient in giving enough reliable data for making product decisions.
  • Indicate Priority Level: High. Lack of accurate data on the behavior or readers can lead to product decisions being made without sufficient information on their effects at-scale, affecting the user experience, and ultimately, potentially leading to a decrease in engagement and pageviews
  • Main Requestors: Web team
  • Ideal Delivery Date: Q1 - Q2 FY2022-2023
  • Stakeholders: Olga Vasileva, Jennifer Wang

Request Documentation

Document TypeRequired?Document/Link
Related PHAB TicketsYes<add link here>
Product One PagerYeshttps://docs.google.com/document/d/1-QFqZmu0rRGulVdr-s1sTpeuRxRTsSq9pzDMsWlhn_A/edit#heading=h.gc3dsee597x7
Product Requirements Document (PRD)Yes<add link here>
Product RoadmapNo<add link here>
Product Planning/Business CaseNo<add link here>
Product BriefNo<add link here>
Other LinksNo<add links here>

Event Timeline

MMiller_WMF renamed this task from Provide experimentation capabilities for logged-out users to Experimentation capabilities for logged-out users.May 19 2022, 6:03 PM
DAbad triaged this task as Low priority.Jun 8 2022, 3:33 PM