Change Details

== Background Our primary metric for this experiment is number of account creations for control vs. treatment. === Design requirements [[ https://www.figma.com/design/Q3pYKI7RRMdRRgkQp2RiTf/Web--Reading-List-Collections?node-id=2365-98882&p=f&t=D6jFYMUytMB9JXFv-0 | Figma file ]] --- == Requirements === Technical requirements - [[ https://docs.google.com/spreadsheets/d/1TIVOWHCsTIZBlXZQYXPr2ZLku18kCG8wiJjLuo5QPCA/edit?usp=sharing | Instrumentation spec ]] - [[ https://docs.google.com/document/d/1-je0hRMcuflxr4xRf9irw3uuWlbyWXP3CksejFUe4LE/edit?tab=t.0 | Measurement plan ]] In T422177, we did the following for the treatment group: - WikimediaEvents: - Added our experiment to `modules/ext.wikimediaEvents/accountCreation/experiments.js` - Added a JS config var that, if present, indicates that an account was just created within the experiment and an `account_created` event should be sent - ReadingLists: - Added a `returntoquery` param to the "create account" link in the CTA dialog with a special URL query param, `readingListsAccountCreationCta=1` - Add an `onCentralAuthPostLoginRedirect` handler to look for that query param and, if present, add an `accountJustCreated=1` param. This param is used in WikimediaEvents. To track account creations for the control group, we should be able to simply add the same `readingListsAccountCreationCta=1` param to the "create account" link in the watchstar CTA dialog. We'll also need to make sure `type=signup` is present there. The create account link is built in MobileFrontend, so we'd need to edit the code there unlelss we can figure out a reasonable way to do this in WikimediaEvents. === Acceptance criteria - [] For the control group, send an `account_created` action when a user successfully creates an account === BDD - //For QA engineer to fill out.// === Test Steps - //For QA engineer to fill out.// === Communication criteria n/a === Rollback plan We could turn off the experiment in Test Kitchen if needed. //This task was created by Version 1.0.0 of the Reader Experience team task template using [[ https://phabulous.toolforge.org/ | phabulous ]].//

== Background Our primary metric for this experiment is number of account creations for control vs. treatment. === Design requirements [[ https://www.figma.com/design/Q3pYKI7RRMdRRgkQp2RiTf/Web--Reading-List-Collections?node-id=2365-98882&p=f&t=D6jFYMUytMB9JXFv-0 | Figma file ]] --- == Requirements === Technical requirements - [[ https://docs.google.com/spreadsheets/d/1TIVOWHCsTIZBlXZQYXPr2ZLku18kCG8wiJjLuo5QPCA/edit?usp=sharing | Instrumentation spec ]] - [[ https://docs.google.com/document/d/1-je0hRMcuflxr4xRf9irw3uuWlbyWXP3CksejFUe4LE/edit?tab=t.0 | Measurement plan ]] In T422177, we did the following for the treatment group: - WikimediaEvents: - Added our experiment to `modules/ext.wikimediaEvents/accountCreation/experiments.js` - Added a JS config var that, if present, indicates that an account was just created within the experiment and an `account_created` event should be sent - ReadingLists: - Added a `returntoquery` param to the "create account" link in the CTA dialog with a special URL query param, `readingListsAccountCreationCta=1` - Add an `onCentralAuthPostLoginRedirect` handler to look for that query param and, if present, add an `accountJustCreated=1` param. This param is used in WikimediaEvents. To track account creations for the control group, we should be able to simply add the same `readingListsAccountCreationCta=1` param to the "create account" link in the watchstar CTA dialog. We'll also need to make sure `type=signup` is present there. The create account link is built in MobileFrontend, so we'd need to edit the code there unlelss we can figure out a reasonable way to do this in WikimediaEvents. === Acceptance criteria - [] For the control group, send an `account_created` action when a user successfully creates an account === BDD ``` Feature: Account creation tracking for the control group Scenario: Control-group account creation via the watchstar CTA Given I am a logged-out user on mobile web (Minerva) in the control group And I tapped the watchstar icon and then "Sign up" When I successfully complete account creation Then the create-account link carried type=signup and readingListsAccountCreationCta=1 And an account_created event is sent for the control group ``` === Test Steps **Test Case 1: Account creation (control)** # Open an article logged out, mobile/Minerva, bucketed into control; open the Network tab. # Tap the watchstar icon, then "Sign up". # AC1: The create-account link carries type=signup and readingListsAccountCreationCta=1. # Complete account creation. # AC2: An account_created event is sent for the control group. **QA Results - Prod** | AC | Status | Details | | --- | --- | --- | | 1 | | | | 2 | | | === Communication criteria n/a === Rollback plan We could turn off the experiment in Test Kitchen if needed. //This task was created by Version 1.0.0 of the Reader Experience team task template using [[ https://phabulous.toolforge.org/ | phabulous ]].//

== Background Our primary metric for this experiment is number of account creations for control vs. treatment. === Design requirements [[ https://www.figma.com/design/Q3pYKI7RRMdRRgkQp2RiTf/Web--Reading-List-Collections?node-id=2365-98882&p=f&t=D6jFYMUytMB9JXFv-0 | Figma file ]] --- == Requirements === Technical requirements - [[ https://docs.google.com/spreadsheets/d/1TIVOWHCsTIZBlXZQYXPr2ZLku18kCG8wiJjLuo5QPCA/edit?usp=sharing | Instrumentation spec ]] - [[ https://docs.google.com/document/d/1-je0hRMcuflxr4xRf9irw3uuWlbyWXP3CksejFUe4LE/edit?tab=t.0 | Measurement plan ]] In T422177, we did the following for the treatment group: - WikimediaEvents: - Added our experiment to `modules/ext.wikimediaEvents/accountCreation/experiments.js` - Added a JS config var that, if present, indicates that an account was just created within the experiment and an `account_created` event should be sent - ReadingLists: - Added a `returntoquery` param to the "create account" link in the CTA dialog with a special URL query param, `readingListsAccountCreationCta=1` - Add an `onCentralAuthPostLoginRedirect` handler to look for that query param and, if present, add an `accountJustCreated=1` param. This param is used in WikimediaEvents. To track account creations for the control group, we should be able to simply add the same `readingListsAccountCreationCta=1` param to the "create account" link in the watchstar CTA dialog. We'll also need to make sure `type=signup` is present there. The create account link is built in MobileFrontend, so we'd need to edit the code there unlelss we can figure out a reasonable way to do this in WikimediaEvents. === Acceptance criteria - [] For the control group, send an `account_created` action when a user successfully creates an account === BDD - //For QA engineer to fill out.//``` Feature: Account creation tracking for the control group Scenario: Control-group account creation via the watchstar CTA Given I am a logged-out user on mobile web (Minerva) in the control group And I tapped the watchstar icon and then "Sign up" When I successfully complete account creation Then the create-account link carried type=signup and readingListsAccountCreationCta=1 And an account_created event is sent for the control group ``` === Test Steps - //For QA engineer to fill out.//**Test Case 1: Account creation (control)** # Open an article logged out, mobile/Minerva, bucketed into control; open the Network tab. # Tap the watchstar icon, then "Sign up". # AC1: The create-account link carries type=signup and readingListsAccountCreationCta=1. # Complete account creation. # AC2: An account_created event is sent for the control group. **QA Results - Prod** | AC | Status | Details | | --- | --- | --- | | 1 | | | | 2 | | | === Communication criteria n/a === Rollback plan We could turn off the experiment in Test Kitchen if needed. //This task was created by Version 1.0.0 of the Reader Experience team task template using [[ https://phabulous.toolforge.org/ | phabulous ]].//