Account Creation CTA experiment: show "save article" button to treatment group
Open, HighPublic3 Estimated Story Points
Actions

Assigned To

None

Authored By

	AnneT
	Apr 2 2026, 1:38 PM

Description

Background

We want to experiment with showing a logged-out user on mobile web the "save article" functionality and see if this will be more likely to encourage them to create an account compared to the control. In this A/B experiment, the treatment group user will see a bookmark icon instead of the watchstar icon.

User story

As a logged out user reading an article on mobile web, I am bucketed into the treatment group of the A/B test. I see a bookmark button instead of the normal "watch star" button at the top of the article.

Design requirements

Figma file

Requirements

Acceptance criteria

On mobile web, for the treatment group, the bookmark button replaces the watchstar button in the page actions menu
Desktop experience is not affected for treatment group
Bookmark button still works for those opted into ReadingLists
Watchstar button still displays for users not in the treatment group

BDD

✅ Scenario 1: a mobile non-logged user in treatment group will see "save article" button

Given a mobile non-logged user is in a treatment group
When a user is on an article page
Then a user sees a the "save button"

✅ Scenario 2: a desktop non-logged user in control/treatment group will NOT see "save article" button

Given a desktop non-logged user is in an either treatment or control group
When a user is on an article page
Then a user sees a the "star (Watchlist)"

✅ Scenario 3: the event experiment_exposure will be triggered for a mobile non-logged user in treatment group when the "save article" button is displayed

Given a mobile non-logged user is in a treatment group
When a user is on an article page
Then a user sees a the "save button"
And the event experiment_exposure is triggered

Test Steps

To test the scenarios above use

?mpo=account-creation-reading-list-cta:treatment

Communication criteria

Add if this needs an announcement or discussion.

Rollback plan

Reverting this patch would be a sensible way of removing the experimental UI entirely if needed

This task was created by Version 1.0.0 of the Reader Experience team task template using phabulous.

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	[Account creation CTA]: Show bookmark button for treatment group	mediawiki/extensions/ReadingLists	master	+122 -35
	Remove logic making watchstar and bookmark mutually exclusive	mediawiki/skins/MinervaNeue	master	+8 -10

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T409236 [EPIC] Account Creation Experiments (WE1.8 FY 25-26)
Open	None	T420238 [EPIC] WE 1.8.5 "Save article" Account Creation CTA experiment on mobile web
Open	None	T421999 [Parent task] Account Creation CTA experiment: Build UI on mobile web
Open	None	T422157 Account Creation CTA experiment: show "save article" button to treatment group

Event Timeline

AnneT created this task.Apr 2 2026, 1:38 PM

AnneT updated the task description. (Show Details)Apr 2 2026, 1:45 PM

AnneT updated the task description. (Show Details)

AnneT mentioned this in T422167: Account Creation CTA experiment: add the account creation dialog.Apr 2 2026, 2:15 PM

AnneT mentioned this in T422169: Account Creation CTA experiment: handle experience after account creation.Apr 2 2026, 2:24 PM

AnneT mentioned this in T422171: Account Creation CTA experiment: handle experience after login for treatment group.Apr 2 2026, 2:29 PM

Jdrewniak added a project: FY25-26 Reading Lists (Logged-out CTA WE 1.8.5).Apr 2 2026, 4:26 PM

Jdrewniak moved this task from Backlog to Logged out UI on the FY25-26 Reading Lists (Logged-out CTA WE 1.8.5) board.Apr 2 2026, 4:36 PM

I assume temp accounts are not included in this experiment (and idk if that is even possible for this)?

HFan-WMF triaged this task as High priority.Apr 7 2026, 4:58 PM

HFan-WMF moved this task from Incoming to Needs refinement on the Reader Experience Team board.

Jdlrobson-WMF set the point value for this task to 2.Apr 7 2026, 5:01 PM

Jdlrobson-WMF moved this task from Needs refinement to Ready for sprint on the Reader Experience Team board.

In T422157#11786052, @aude wrote:

I assume temp accounts are not included in this experiment (and idk if that is even possible for this)?

According to the Test Kitchen docs, the mw-user identifier type includes temp accounts, and no such notice is included for edge-unique. I think we can assume temp accounts won't be included during bucketing, and worst case, we could filter them out during data analysis.

LMora-WMF edited projects, added Reader Experience Team (REx Sprint 18 [Q4 Apr 7 - Apr 20]); removed Reader Experience Team.Mon, Apr 13, 5:28 PM

AnneT claimed this task.Mon, Apr 13, 5:30 PM

AnneT moved this task from Ready to In progress on the Reader Experience Team (REx Sprint 18 [Q4 Apr 7 - Apr 20]) board.Tue, Apr 14, 6:04 PM

AnneT mentioned this in T422174: Account Creation CTA experiment: track experiment exposure.Wed, Apr 15, 2:17 PM

Change #1271764 had a related patch set uploaded (by Anne Tomasevich; author: Anne Tomasevich):

[mediawiki/skins/MinervaNeue@master] Remove logic making watchstar and bookmark mutually exclusive

https://gerrit.wikimedia.org/r/1271764

Change #1271765 had a related patch set uploaded (by Anne Tomasevich; author: Anne Tomasevich):

[mediawiki/extensions/ReadingLists@master] [Account creation CTA]: Show the bookmark button

https://gerrit.wikimedia.org/r/1271765

To test:

Pull the ReadingLists patch.
Pull the WikimediaEvents patch that sets up the instrument.
Create a new A/B test in your local TestKitchen UI matching the real configuration.
Turn your new A/B test on.
Follow TK docs to backdate the start date of your new A/B test.
Force enrollment into the experiment groups ("control" and "treatment"). The Innsman browser extension did not work for me for this.

AnneT changed the point value for this task from 2 to 3.Wed, Apr 15, 9:10 PM

Change #1271764 abandoned by Anne Tomasevich:

[mediawiki/skins/MinervaNeue@master] Remove logic making watchstar and bookmark mutually exclusive

Reason:

not needed

https://gerrit.wikimedia.org/r/1271764

AnneT removed AnneT as the assignee of this task.Mon, Apr 20, 1:40 PM

AnneT moved this task from In progress to Needs code review on the Reader Experience Team (REx Sprint 18 [Q4 Apr 7 - Apr 20]) board.

AnneT moved this task from REx Sprint 18 [Q4 Apr 7 - Apr 20] to REx Sprint 19 [Q4 Apr 21 - May 4] on the Reader Experience Team board.Tue, Apr 21, 5:20 PM

AnneT edited projects, added Reader Experience Team (REx Sprint 19 [Q4 Apr 21 - May 4]); removed Reader Experience Team (REx Sprint 18 [Q4 Apr 7 - Apr 20]).

AnneT moved this task from Ready to Needs code review on the Reader Experience Team (REx Sprint 19 [Q4 Apr 21 - May 4]) board.Tue, Apr 21, 5:37 PM

Change #1271765 merged by jenkins-bot:

[mediawiki/extensions/ReadingLists@master] [Account creation CTA]: Show bookmark button for treatment group

https://gerrit.wikimedia.org/r/1271765

ReleaseTaggerBot added a project: MW-1.46-notes (1.46.0-wmf.26; 2026-04-28).Tue, Apr 21, 9:00 PM

AnneT moved this task from Needs code review to Needs QA on the Reader Experience Team (REx Sprint 19 [Q4 Apr 21 - May 4]) board.Tue, Apr 21, 9:28 PM

Maintenance_bot removed a project: Patch-For-Review.Tue, Apr 21, 9:30 PM

Etonkovidova updated the task description. (Show Details)Tue, Apr 28, 9:11 PM

Etonkovidova updated the task description. (Show Details)Tue, Apr 28, 9:19 PM

(edited) Disregard the note below - T422167: Account Creation CTA experiment: add the account creation dialog works with ?mpo=account-creation-reading-list-cta:treatment in the incognito window.
Note: @AnneT - when using ?mpo=account-creation-reading-list-cta:treatment to override a user group assignment, the "save article" button is not clickable.

Account Creation CTA experiment: show "save article" button to treatment groupOpen, HighPublic3 Estimated Story PointsActions