Background
We want to track clicks for the control group, who will see the watchstar button, so we can compare them to the treatment group's activity.
Design requirements
Requirements
Technical requirements
Acceptance criteria
- Send a click action when a user in the control group taps the watchstar button
- Send an init action when the login/create account popup displays
- Send a click action when a user clicks the login button
- Send a click action when a user clicks the create account button
- If at all possible, avoid writing code in MobileFrontend
BDD
Feature: Click tracking for the control group (watchstar CTA)
Scenario: Open the watchstar drawer
Given I am a logged-out user on mobile web (Minerva) in the control group
When I tap the watchstar icon
Then a click event with action_subtype=save_article_to_watchlist is sent
And an init event with action_subtype=init_sign_up is sent when the drawer displays
Scenario: Click "Sign up"
Given the drawer is shown
When I tap "Sign up"
Then a click event with action_context=sign_up is sent
And the Create account page opens
Scenario: Click "Log in"
Given the drawer is shown
When I tap "Log in"
Then a click event with action_context=login is sent
And the Log in page opensTest Steps
Test Case 1: Watchstar tap + drawer
- Open an article logged out, mobile/Minerva, bucketed into control; open the Network tab.
- Tap the watchstar icon.
- AC1: A click event is sent with action_subtype=save_article_to_watchlist.
- AC2: An init event is sent with action_subtype=init_sign_up when the drawer displays.
Test Case 2: Sign up
- In the drawer, tap "Sign up".
- AC3: A click event is sent with action_context=sign_up, and the Create account page opens.
Test Case 3: Log in
- Re-open the drawer and tap "Log in".
- AC4: A click event is sent with action_context=login, and the Log in page opens.
QA Results - Beta
| AC | Status | Details for test run [ T422175#11982596 ] |
|---|---|---|
| 1 | ✅ | console (beta, mpo:control) — click/save_article_to_watchlist — see T422175_beta_AC1_1.png |
| 2 | ✅ | console (beta, mpo:control) — init/init_sign_up — see T422175_beta_AC1_1.png |
| 3 | ✅ | console click/sign_up → Create account — see T422175_beta_AC3_1.png; prod T424561 (77 events) |
| 4 | ✅ | prod delivery T424561 (control click login = 276 events); "Log in" present in drawer (AC1 shot) |
Communication criteria
n/a
Rollback plan
We could turn off the experiment in Test Kitchen if needed.
This task was created by Version 1.0.0 of the Reader Experience team task template using phabulous.
