Background
We want to track clicks for the treatment group, who will see the bookmark button, so we can compare them to the control group's activity.
Design requirements
Requirements
Technical requirements
Acceptance criteria
- Send a click action when a user in the treatment group taps the bookmark button
- Send an init action when the login/create account popup displays
- Send a click action when a user clicks the login button
- Send a click action when a user clicks the create account button
BDD
Feature: Click tracking for the treatment group (bookmark CTA)
Scenario: Open the bookmark popover
Given I am a logged-out user on mobile web (Minerva) in the treatment group
When I tap the bookmark icon
Then a click event with action_subtype=save_article_to_reading_list is sent
And an init event with action_subtype=init_sign_up is sent when the popover displays
Scenario: Click "Create account"
Given the popover is shown
When I tap "Create account"
Then a click event with action_context=sign_up is sent
And the Create account page opens
Scenario: Click "Log in"
Given the popover is shown
When I tap "Log in"
Then a click event with action_context=login is sent
And the Log in page opensTest Steps
Test Case 1: Bookmark tap + popover
- Open an article logged out, mobile/Minerva, bucketed into treatment; open the Network tab.
- Tap the bookmark icon.
- AC1: A click event is sent with action_subtype=save_article_to_reading_list.
- AC2: An init event is sent with action_subtype=init_sign_up when the popover displays.
Test Case 2: Create account
- In the popover, tap "Create account".
- AC3: A click event is sent with action_context=sign_up, and the Create account page opens.
Test Case 3: Log in
- Re-open the popover and tap "Log in".
- AC4: A click event is sent with action_context=login, and the Log in page opens.
QA Results - Beta
| AC | Status | Details for test run [ T422176#11982611 ] |
|---|---|---|
| 1 | ✅ | console (beta, mpo:treatment) — click/save_article_to_reading_list — see T422176_beta_AC1_1.png; prod T424561 (12,075 events) |
| 2 | ✅ | console (beta, mpo:treatment) — init/init_sign_up — see T422176_beta_AC1_1.png; prod T424561 (12,082 events) |
| 3 | ✅ | console click/sign_up → Create account — see T422176_beta_AC3_1.png; prod T424561 (949 events) |
| 4 | ✅ | prod delivery T424561 (treatment click login = 661 events); "Log in" present in popover (AC1 shot) |
Communication criteria
n/a
Rollback plan
We could turn off the experiment in Test Kitchen if needed.
This task was created by Version 1.0.0 of the Reader Experience team task template using phabulous.
