Variant tests: D-mobile
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	MMiller_WMF
	Apr 16 2020, 10:40 PM

Description

The background for this variant test can be found in T246533: Variant tests: "initiation part 2" test (C vs. D). It contains two versions of the desktop workflow and two versions of the mobile workflow. This task is about Variant D for the mobile.

Mockups

On first arrival to the homepage - showing the banner and the pre-initiation SE preview
Onboarding 1 of 2 (general)- onboarding with intro and topic filters for selection (same as var A/B)
Onboarding 1 of 2 (image) - version with intro if user answered the survey saying "Add an image" as their motivation for creating an account
Onboarding 2 of 2 - difficulty onboarding with task difficulty checkboxes for selection

Specifications

Start module reduced to only the email submodule. The user does not need to be able to dismiss this.
When the user first arrives on their homepage, they should get a drawer that comes up from the bottom of the screen. When the drawer is open, the rest of the screen is shaded over.
- Header: "Welcome to your homepage!"
- Body: "You can learn to edit, contact your mentor, and see the impact of your work."
- The drawer is dismissable by tapping outside of it.
- After the user dismisses the drawer, they will never see this drawer again.
- With the advent of this drawer, we should remove the "Welcome to your homepage!" header on the banner that explains to users how to return, implemented in T224883: Homepage: discovery of homepage after account creation (mobile).
Suggested edits preview (pre-initiation)
- On the homepage, this variant employs an entirely new suggested edits preview, which shows a strong call to action.
- It is outlined in blue, unlike the other modules.
- Header (large text): "Get started with suggested edits"
- Graphic: tool/lightbulb graphic
- Body: "Help add to the world's knowledge with some easy fixes on Wikipedia articles."
- Button: "Get suggestions", which begins the onboarding.
Onboarding
- These are the same overlays as described in T250343: Variant tests: D-desktop.
- When the user completes this onboarding, they should be on the full suggested edits module.
Suggested edits preview (post-initiation)
- After the user has completed the onboarding, when they return to the homepage, they should see the same preview as described in T250440: Variant tests: C-mobile, which shows a miniature version of an actual suggestion.
- From this point on, business rules are the same as in T250440.
Instrumentation
- This instrumentation happens in addition to the normal homepage instrumentation.
- We should record an impression event for the banner.
- We should record a "close" event for dismissing the banner.
- We should record events for the topic onboarding the same way as for the topic overlay in Variant A.
- For the difficulty onboarding, we should record that the user clicked to "Get suggestions". We should also record their difficulty selections like we do with the difficulty filters. But we should be able to tell that those selections happened in the onboarding, not in the filters.

Related Objects
Search...

Status	Assigned	Task
Resolved	MMiller_WMF	T238887 [EPIC] Growth: Homepage variant tests
Resolved	RHo	T246533 Variant tests: "initiation part 2" test (C vs. D)
Resolved	MMiller_WMF	T250451 Variant tests: D-mobile
Resolved	Catrope	T258008 Variant C/D: smaller start module
Declined	None	T258015 Variant D: welcome banner
Resolved	• mewoph	T258017 Variant D: difficulty overlay in onboarding
Resolved	kostajh	T258022 Variant D: mobile preview for suggested edits module with call to action
Resolved	kostajh	T258010 Variant C/D: welcome peek drawer on mobile
Resolved	Tgr	T262485 Variant C/D: instrumentation

Event Timeline

MMiller_WMF created this task.Apr 16 2020, 10:40 PM

@RHo -- please have a read over this to make sure I got the specifications right and didn't miss anything. I have one question. Are you sure we should have that explanatory banner at the top? While it is unobtrusive enough on desktop, it seems to take up a lot of space on mobile. The team went through a discussion and decided to remove a similar banner last year. If you think this will make a positive impact, then let's keep it, but I wanted to double check -- we don't need to keep it just to have parity with desktop.

MMiller_WMF edited projects, added Growth-Team (Sprint 0 (Growth Team)); removed Growth-Team.Apr 16 2020, 10:55 PM

MMiller_WMF moved this task from Incoming to Ready for Development on the Growth-Team (Sprint 0 (Growth Team)) board.

RHo mentioned this in T246533: Variant tests: "initiation part 2" test (C vs. D).Apr 29 2020, 5:54 PM

In T250451#6064511, @MMiller_WMF wrote:

@RHo -- please have a read over this to make sure I got the specifications right and didn't miss anything. I have one question. Are you sure we should have that explanatory banner at the top? While it is unobtrusive enough on desktop, it seems to take up a lot of space on mobile. The team went through a discussion and decided to remove a similar banner last year. If you think this will make a positive impact, then let's keep it, but I wanted to double check -- we don't need to keep it just to have parity with desktop.

Let's keep it because it is important to have some welcoming/intro message in lieu of the Start module. Also the design of this is message ensures it is dismissable by users, which is different to the design discussed in T223144.
However, we should as a whole look to reduce these intro and onboarding messages to be less verbose. I created T251458 to track this work.

RHo updated the task description. (Show Details)May 1 2020, 11:11 PM

MMiller_WMF updated the task description. (Show Details)Jul 7 2020, 4:07 AM

@RHo -- similar question as on T250331#6283867. On mobile, when users first visit their homepage from the welcome survey progressive button, they have a banner about how to return there (screenshot below). Would this conflict with the banner from this mockup?

In T250451#6284208, @MMiller_WMF wrote:

@RHo -- similar question as on T250331#6283867. On mobile, when users first visit their homepage from the welcome survey progressive button, they have a banner about how to return there (screenshot below). Would this conflict with the banner from this mockup?

Hmm so this conflicts more than Variant D desktop, since the dismissible notice on the homepage, whereas this is mobile banner pushes the page content down so two welcome messages appearing in succession will look wrong.
I think we should incorporate the the message about returning to the homepage into the new var D welcome style here. Something like:

Welcome to your homepage on Wikipedia. From here, you can learn more about different ways to edit, keep track of your contributions, and ask experienced users how to get started. 
You can always return here by selecting [icon + username] in the menu [menu icon].

RHo mentioned this in T250440: Variant tests: C-mobile.Jul 7 2020, 12:01 PM

In T250451#6285213, @RHo wrote:
In T250451#6284208, @MMiller_WMF wrote:

@RHo -- similar question as on T250331#6283867. On mobile, when users first visit their homepage from the welcome survey progressive button, they have a banner about how to return there (screenshot below). Would this conflict with the banner from this mockup?

Hmm so this conflicts more than Variant D desktop, since the dismissible notice on the homepage, whereas this is mobile banner pushes the page content down so two welcome messages appearing in succession will look wrong.
I think we should incorporate the the message about returning to the homepage into the new var D welcome style here. Something like:
Welcome to your homepage on Wikipedia. From here, you can learn more about different ways to edit, keep track of your contributions, and ask experienced users how to get started. 
You can always return here by selecting [icon + username] in the menu [menu icon].

After discussing with @MMiller_WMF, here is a revised proposal to incorporate the var D Welcome banner message into the existing discovery pop-up instead. This is mainly because we want to keep this return-to-homepage discovery feature for both new variants.