Page MenuHomePhabricator

Variant tests: D-mobile
Closed, ResolvedPublic

Description

The background for this variant test can be found in T246533: Variant tests: "initiation part 2" test (C vs. D). It contains two versions of the desktop workflow and two versions of the mobile workflow. This task is about Variant D for the mobile.

Mockups

Specifications

  • Start module reduced to only the email submodule. The user does not need to be able to dismiss this.
  • When the user first arrives on their homepage, they should get a drawer that comes up from the bottom of the screen. When the drawer is open, the rest of the screen is shaded over.
    • Header: "Welcome to your homepage!"
    • Body: "You can learn to edit, contact your mentor, and see the impact of your work."
    • The drawer is dismissable by tapping outside of it.
    • After the user dismisses the drawer, they will never see this drawer again.
    • With the advent of this drawer, we should remove the "Welcome to your homepage!" header on the banner that explains to users how to return, implemented in T224883: Homepage: discovery of homepage after account creation (mobile).
  • Suggested edits preview (pre-initiation)
    • On the homepage, this variant employs an entirely new suggested edits preview, which shows a strong call to action.
    • It is outlined in blue, unlike the other modules.
    • Header (large text): "Get started with suggested edits"
    • Graphic: tool/lightbulb graphic
    • Body: "Help add to the world's knowledge with some easy fixes on Wikipedia articles."
    • Button: "Get suggestions", which begins the onboarding.
  • Onboarding
    • These are the same overlays as described in T250343: Variant tests: D-desktop.
    • When the user completes this onboarding, they should be on the full suggested edits module.
  • Suggested edits preview (post-initiation)
    • After the user has completed the onboarding, when they return to the homepage, they should see the same preview as described in T250440: Variant tests: C-mobile, which shows a miniature version of an actual suggestion.
    • From this point on, business rules are the same as in T250440.
  • Instrumentation
    • This instrumentation happens in addition to the normal homepage instrumentation.
    • We should record an impression event for the banner.
    • We should record a "close" event for dismissing the banner.
    • We should record events for the topic onboarding the same way as for the topic overlay in Variant A.
    • For the difficulty onboarding, we should record that the user clicked to "Get suggestions". We should also record their difficulty selections like we do with the difficulty filters. But we should be able to tell that those selections happened in the onboarding, not in the filters.

Event Timeline

@RHo -- please have a read over this to make sure I got the specifications right and didn't miss anything. I have one question. Are you sure we should have that explanatory banner at the top? While it is unobtrusive enough on desktop, it seems to take up a lot of space on mobile. The team went through a discussion and decided to remove a similar banner last year. If you think this will make a positive impact, then let's keep it, but I wanted to double check -- we don't need to keep it just to have parity with desktop.

@RHo -- please have a read over this to make sure I got the specifications right and didn't miss anything. I have one question. Are you sure we should have that explanatory banner at the top? While it is unobtrusive enough on desktop, it seems to take up a lot of space on mobile. The team went through a discussion and decided to remove a similar banner last year. If you think this will make a positive impact, then let's keep it, but I wanted to double check -- we don't need to keep it just to have parity with desktop.

Let's keep it because it is important to have some welcoming/intro message in lieu of the Start module. Also the design of this is message ensures it is dismissable by users, which is different to the design discussed in T223144.
However, we should as a whole look to reduce these intro and onboarding messages to be less verbose. I created T251458 to track this work.

@RHo -- similar question as on T250331#6283867. On mobile, when users first visit their homepage from the welcome survey progressive button, they have a banner about how to return there (screenshot below). Would this conflict with the banner from this mockup?

@RHo -- similar question as on T250331#6283867. On mobile, when users first visit their homepage from the welcome survey progressive button, they have a banner about how to return there (screenshot below). Would this conflict with the banner from this mockup?

Hmm so this conflicts more than Variant D desktop, since the dismissible notice on the homepage, whereas this is mobile banner pushes the page content down so two welcome messages appearing in succession will look wrong.
I think we should incorporate the the message about returning to the homepage into the new var D welcome style here. Something like:

Welcome to your homepage on Wikipedia. From here, you can learn more about different ways to edit, keep track of your contributions, and ask experienced users how to get started. 
You can always return here by selecting [icon + username] in the menu [menu icon].

@RHo -- similar question as on T250331#6283867. On mobile, when users first visit their homepage from the welcome survey progressive button, they have a banner about how to return there (screenshot below). Would this conflict with the banner from this mockup?

Hmm so this conflicts more than Variant D desktop, since the dismissible notice on the homepage, whereas this is mobile banner pushes the page content down so two welcome messages appearing in succession will look wrong.
I think we should incorporate the the message about returning to the homepage into the new var D welcome style here. Something like:

Welcome to your homepage on Wikipedia. From here, you can learn more about different ways to edit, keep track of your contributions, and ask experienced users how to get started. 
You can always return here by selecting [icon + username] in the menu [menu icon].

After discussing with @MMiller_WMF, here is a revised proposal to incorporate the var D Welcome banner message into the existing discovery pop-up instead. This is mainly because we want to keep this return-to-homepage discovery feature for both new variants.

I updated the description to replace the welcome banner with a welcome drawer. I will propagate this to the other tasks.

I will resolve this parent task when the children are resolved.