Page MenuHomePhabricator

Variant tests: D-desktop
Closed, ResolvedPublic

Description

The background for this variant test can be found in T246533: Variant tests: "initiation part 2" test (C vs. D). It contains two versions of the desktop workflow and two versions of the mobile workflow. This task is about Variant D for the desktop.

Mockups

Specifications

  • Start module reduced to only the email submodule. There is no option to dismiss it.
  • The initialized suggested edits module will be large-sized, on left side of homepage. It will display the card feed once it's initialized.
  • Suggested edits module
    • When the user arrives on the page, the suggested edits module is on the page.
    • Topic onboarding
      • At first, the module displays the content previously contained in the "topic overlay" as engineered in T238610: Newcomer tasks: include topics in intro overlay, including the headers, counter at the bottom, and the personalization from welcome survey responses.
      • The copy will be largely the same as what was shown in the overlay, with some slight changes since the element is no longer an overlay. The following are the only two changed messages:
        • For users who said they wanted to correct a typo or error: When you created your account, you said you wanted to fix a typo or error. Here, you can find suggestions of small edits to get started. If you would rather go straight to fixing a specific article, you can search for the article and click "Edit".
        • For users who said they want to add or change information in an existing article: When you created your account, you said you wanted to add or change information on an existing article. Here, you can find suggestions of small edits to get started. If you would rather go straight to changing a specific article, you can search for the article and click "Edit".
      • The only button is "Continue", which advances to difficulty onboarding.
    • Difficulty onboarding
      • After advancing from topic onboarding, the user sees content that is like a cross between the difficulty overlay from T235723: Newcomer tasks: intro and difficulty overlays and the difficulty filters from T235042: Newcomer tasks: implement difficulty filters. It has the top of the overlay (the header and sentence), but the bottom of the filters (the checkboxes and counter).
      • The user can select and deselect these different task types, essentially setting their filters in advance.
      • There is a "Back" button to return to the topic screen, and a button to "Get suggestions", which completes the onboarding.
    • After the onboarding, the module displays on the page. There is no way to re-experience the onboarding.
  • Popup
    • This popup (and the one for T250331: Variant tests: C-desktop) obsoletes the popup implemented in T222852: Homepage: discovery of homepage after account creation (desktop) that explains how the user should return to the homepage.
    • When the user first arrives on their homepage, they will see a popup on top of the page that is pointing to their username.
    • Header: "Welcome to your homepage!"
    • Body: "You can always click on your username to return here. On your homepage, you can find suggested edits, ask questions to your mentor, and see your impact."
    • The popup is dismissable with an "X" in the upper right and also by clicking on the screen outside of it.
    • After the user dismisses it, they should never see it again.
  • Instrumentation
    • This instrumentation happens in addition to the normal homepage instrumentation.
    • We should record an impression event for the banner.
    • We should record a "close" event for dismissing the banner.
    • We should record events for the topic onboarding the same way as for the topic overlay in Variant A.
    • For the difficulty onboarding, we should record that the user clicked to "Get suggestions". We should also record their difficulty selections like we do with the difficulty filters. But we should be able to tell that those selections happened in the onboarding, not in the filters.

Related Objects

Event Timeline

@RHo -- please have a read over this to make sure I got the specifications right and didn't miss anything. I have one question. On the second screen of the onboarding, there is no option to go back to the first topic screen. Is that deliberate? I think it's probably okay -- we don't want the user to dawdle and potentially get stuck or distracted in onboarding; we want them to get to the module.

@RHo -- please have a read over this to make sure I got the specifications right and didn't miss anything. I have one question. On the second screen of the onboarding, there is no option to go back to the first topic screen. Is that deliberate? I think it's probably okay -- we don't want the user to dawdle and potentially get stuck or distracted in onboarding; we want them to get to the module.

Actually missing Back was an oversight on my part, thanks for noticing - FTFY.

@RHo -- I have the same question as in T250331#6283867. That popup potentially conflicts with the welcome banner in this variant (and will happen to the majority of users). What do you think we should do?

@RHo -- I have the same question as in T250331#6283867. That popup potentially conflicts with the welcome banner in this variant (and will happen to the majority of users). What do you think we should do?

For variant D desktop where the SE onboarding is part of the homepage and this pop-up is a dialog on top, I don't think it physically conflicts, but the copy on Desktop could be revised and shortened.

@RHo -- I have the same question as in T250331#6283867. That popup potentially conflicts with the welcome banner in this variant (and will happen to the majority of users). What do you think we should do?

For variant D desktop where the SE onboarding is part of the homepage and this pop-up is a dialog on top, I don't think it physically conflicts, but the copy on Desktop could be revised and shortened.

It could be condensed so that it looks something like this when combined with the varD desktop welcome banner:

image.png (1×1 px, 280 KB)

  • The copy will be largely the same as what was shown in the overlay, with some slight changes since the element is no longer an overlay. The following are the only two changed messages:
    • For users who said they wanted to correct a typo or error: When you created your account, you said you wanted to fix a typo or error. Here, you can find suggestions of small edits to get started. If you would rather go straight to fixing a specific article, you can search for the article and click "Edit".
    • For users who said they want to add or change information in an existing article: When you created your account, you said you wanted to add or change information on an existing article. Here, you can find suggestions of small edits to get started. If you would rather go straight to changing a specific article, you can search for the article and click "Edit".

Are these message changes specific to this variant test, or would it make sense to make these message changes globally (i.e. also in variant A)?

I just updated the task description to do away with the banner and replace it with a popup, bringing it more in line with Variant C. I will migrate these changes to the subtasks.

I will resolve this parent task when the children are resolved.