Background
- Followup to https://phabricator.wikimedia.org/T376374
User story
- As a Wikipedia browser extension user, I would like to be shown the summary feature so that I can gain more knowledge from Wikipedia quickly
As a product team, we would like to learn about usage patterns of the new summary feature so that we can determine whether
Requirement
Summary opens through user actions (i.e. user opens accordion)
If no summary is available, the element does not show on page
If summary does not load, an error state is displayed: "We could not load the summary for this page"
Summaries would only show on English Wikipedia
Buttons: upon clicking button would show in selected state. No other system feedback will be provided. Button can only be clicked once per page. Buttons are in Codex.
BDD
Feature: Summary Experiment UI
Scenario: Summary feature availability based on content
Given the user is on English Wikipedia with the extension enabled
When the summary content is available
Then the summary accordion should be visible and expandable by user action.
Scenario: Error message when summary fails to load
Given the user opens the summary accordion
When the summary content fails to load
Then the user should see an error message stating, "We could not load the summary for this page."
Scenario: No summary accordion displayed if summary unavailable
Given the user is on a page with no summary content
Then the summary accordion should not be shown.
Scenario: Summary button selected state upon click
Given the user sees the summary button
When the user clicks the button
Then the button should enter a selected state
And no further feedback is provided after the click.Test Steps
Test Case 1: Verify summary feature availability based on content
- Enable the Wikipedia browser extension and navigate to an English Wikipedia article.
- Confirm the presence of the summary accordion if content is available.
- Expand the accordion.
- AC1: Confirm that summary content is visible when available.
Test Case 2: Verify error message when summary fails to load
1. Enable the Wikipedia browser extension.
2. Open the summary accordion on an English Wikipedia article.
3. Simulate a summary load failure.
4. AC2: Confirm that the error message, “We could not load the summary for this page,” is displayed.
Test Case 3: Verify no summary display if unavailable
- Enable the Wikipedia browser extension.
- Navigate to an English Wikipedia article with no summary content.
- AC3: Confirm that the summary accordion is not visible on the page.
Test Case 4: Verify summary button selected state
- Enable the Wikipedia browser extension.
- Locate the summary button on an English Wikipedia article.
- Click the summary button once.
- AC4: Confirm that the button is in a selected state and cannot be clicked again on the same page.
QA Results - Prod
| AC | Status | Details |
|---|---|---|
| 1 | ✅ | T378232#10323833 |
| 2 | ✅ | T378232#10323833 |
| 3 | ⬜ | T378232#10323833 |
| 4 | ✅ | T378232#10323833 |
