Page MenuHomePhabricator

Create variant for Article search bar A/B Test
Closed, ResolvedPublic1 Estimated Story Points

Assigned To
None
Authored By
HNordeenWMF
Jan 15 2025, 9:38 PM
Referenced Files
F58217115: image.png
Jan 16 2025, 6:34 PM
F58217111: image.png
Jan 16 2025, 6:33 PM
F58217109: image.png
Jan 16 2025, 6:33 PM
F58208312: image.png
Jan 15 2025, 9:38 PM
F58208309: Screenshot 2025-01-15 at 2.36.36 PM.png
Jan 15 2025, 9:38 PM

Description

Background

We would like to test making the search bar more prominent within the article, our hypothesis is:
If we make the article search bar more prominent, we will increase the number of users who initiate searches by 8%, possibly leading to a 1% increase in search retention rate for logged out users.

Requirements
  • Create variant with full search bar instead of blue magnifying glass
  • Scroll behavior for iPhone
    • Status bar: Transparent (opacity: 95%) and blurred background
    • Scroll-down: Navigation and search bar disappears
    • Scroll-up: Reveals navigation and search bar
  • Scroll behavior for iPad
    • Status bar: Transparent (opacity: 95%) and blurred background
    • Scroll-down: Toolbar is sticky, Navigation and search bar disappears
    • Scroll-up: Reveals navigation and search bar
  • Must function on both iPhone and iPad

A/B test

Screenshot 2025-01-15 at 2.36.36 PM.png (862×1 px, 487 KB)

Designs (for reference, check Figma for most up-to-date)
B Variant iPhoneB variant iPad
image.png (1×786 px, 607 KB)
image.png (1×786 px, 217 KB)
image.png (2×1 px, 1 MB)
image.png (2×1 px, 777 KB)
Engineering Notes
  • L creating the two variants, with no assigning logic tied to it. Considering we already have the magnifying glass variant in place, we need to create the new full bar variant (we probably have that in git history). I'm keeping it as a large, considering that the logic to handle both could be complicated.
  • The magnifying glass option is done in T363606. The work done here can significantly reduce the effort, maybe to an M. I'll not change the preliminary estimation at this point, but that will be considered for the final estimation.
  • TS: A lot of this work is done in the system nav bar PR, just hidden behind a flag (see needsSearchBar flag, set to true, search bar should appear on Article). We might be able to reduce or cut this task.
Notes for QA
  1. Fresh install app, in onboarding, choose one of the target languages from "Requirements" section above. After onboarding dismisses, you will be randomly assigned to the control or test group.
  2. Depending on assignment in step 1, ensure Article search works as expected. To test the other group you will have to re-install and repeat step 1.

Event Timeline

HNordeenWMF renamed this task from Create variants for Article search bar A/B Test to Create variant for Article search bar A/B Test.
HNordeenWMF triaged this task as Low priority.
HNordeenWMF updated the task description. (Show Details)

Estimate assuming this requirements is done as separate task (T383839):

Scroll-down: Toolbar is sticky, Navigation and search bar disappears

System nav bar PR does most of this other work, we just need to fix the profile icon.

Tsevener renamed this task from Create variant for Article search bar A/B Test to [S] Create variant for Article search bar A/B Test.Jan 16 2025, 6:52 PM
Seddon renamed this task from [S] Create variant for Article search bar A/B Test to Create variant for Article search bar A/B Test.Jan 17 2025, 1:10 AM
Seddon set the point value for this task to 1.
Tsevener added a subscriber: scblr.

@scblr

This will be in Experimental build 7.7.0 (217) for design review.

T383822 work will also be in that build if you want to design review that too while I'm waiting for metrics answers.

HNordeenWMF raised the priority of this task from Low to Medium.Feb 6 2025, 8:46 PM

Sorry there was some mixup here - this work was pretty much done within system nav bar, only hidden. I exposed it with with the work in T383829. Moving to Waiting for Build.

Tsevener updated the task description. (Show Details)
Tsevener updated the task description. (Show Details)

Search bar looks correct on RTL for Arabic, asking Amal for a quick review.