Background

Our primary metric for this experiment is number of account creations for control vs. treatment.

Design requirements

Figma file

Requirements

Technical requirements

• Instrumentation spec
• Measurement plan

In T422177, we did the following for the treatment group:

• WikimediaEvents:
  • Added our experiment to modules/ext.wikimediaEvents/accountCreation/experiments.js
  • Added a JS config var that, if present, indicates that an account was just created within the experiment and an account_created event should be sent
• ReadingLists:
  • Added a returntoquery param to the "create account" link in the CTA dialog with a special URL query param, readingListsAccountCreationCta=1
  • Add an onCentralAuthPostLoginRedirect handler to look for that query param and, if present, add an accountJustCreated=1 param. This param is used in WikimediaEvents.

To track account creations for the control group, we should be able to simply add the same readingListsAccountCreationCta=1 param to the "create account" link in the watchstar CTA dialog. We'll also need to make sure type=signup is present there.

The create account link is built in MobileFrontend, so we'd need to edit the code there unlelss we can figure out a reasonable way to do this in WikimediaEvents.

Acceptance criteria

• For the control group, send an account_created action when a user successfully creates an account

BDD

Feature: Account creation tracking for the control group

  Scenario: Control-group account creation via the watchstar CTA
    Given I am a logged-out user on mobile web (Minerva) in the control group
    And I tapped the watchstar icon and then "Sign up"
    When I successfully complete account creation
    Then the create-account link carried type=signup and readingListsAccountCreationCta=1
    And an account_created event is sent for the control group

Test Steps

Test Case 1: Account creation (control)

1. Open an article logged out, mobile/Minerva, bucketed into control; open the Network tab.
2. Tap the watchstar icon, then "Sign up".
3. AC1: The create-account link carries type=signup and readingListsAccountCreationCta=1.
4. Complete account creation.
5. AC2: An account_created event is sent for the control group.

QA Results - Prod

Communication criteria

n/a

Rollback plan

We could turn off the experiment in Test Kitchen if needed.

This task was created by Version 1.0.0 of the Reader Experience team task template using phabulous.