Page MenuHomePhabricator

Newcomer tasks: On mobile, revert to showing a single action to open the Suggested edits from its mobile preview
Closed, ResolvedPublic

Assigned To
Authored By
RHo
Feb 14 2022, 2:55 PM
Referenced Files
F34952579: image.png
Feb 15 2022, 5:47 PM
F34952581: image.png
Feb 15 2022, 5:47 PM
F34952538: Screenshot 2022-02-15 at 17.49.42.png
Feb 15 2022, 4:51 PM
F34952533: Screenshot 2022-02-15 at 17.43.44.png
Feb 15 2022, 4:51 PM
F34952463: image.png
Feb 15 2022, 2:54 PM
F34951785: Screen Shot 2022-02-14 at 2.34.29 PM.png
Feb 14 2022, 10:34 PM
F34939802: image.png
Feb 14 2022, 2:55 PM
F34939805: image.png
Feb 14 2022, 2:55 PM

Description

After reviewing Add a link funnel data, we reevaluated the risk of the design change on T264460: Enable users to open the first suggested article directly from the mobile task preview as being a new vector for bouncing in an already lower performing mobile onboarding funnel.

We want to revert the change as we value providing a clearer path to browsing and selecting a newcomer task for the majority of users, more so than the minority of folks who would save one page load because they wanted to choose the first task in the feed from the homepage.

This task is to roll back the change, but to keep the improved CTA design added by @Sgs:

Mobile
image.png (444×692 px, 32 KB)
Tablet
image.png (454×1 px, 38 KB)

Expected behaviour: Selecting any part of the preview module (including the task first task and button) will open the Suggested edits module.

Event Timeline

If it's not a lot of effort, it seems like it is worth re-analyzing funnel data post-deployment of T264460: Enable users to open the first suggested article directly from the mobile task preview before we roll back this design. The add link funnel data analysis doesn't include data from when this change was live, as I understand it. (cc @nettrom_WMF and @MMiller_WMF )

We have also instrumented taps on the article vs taps on "See all suggestions", so that could be included in the updated funnel to understand how that affects user impacts.

If it's not a lot of effort, it seems like it is worth re-analyzing funnel data post-deployment of {T2664460} before we roll back this design. The add link funnel data analysis doesn't include data from when this change was live, as I understand it. (cc @nettrom_WMF and @MMiller_WMF )

We have also instrumented taps on the article vs taps on "See all suggestions", so that could be included in the updated funnel to understand how that affects user impacts.

Apologies, I meant in the task description that we reviewed the add a link funnel data and determined that we didn't want to introduce another vector for people bouncing, did not mean to imply that we saw data indicating this happened. I will update the description accordingly, but basically we want to revert the change as we value providing a clear path to browsing and selecting a newcomer task for the majority of users, more so than the minority of folks who would save one page load because they wanted to choose the first task in the feed from the homepage.

Hi @RHo, should an arrow be added to the top corner of the module as well (similar to other modules where the entire container is a tap target)?

Screen Shot 2022-02-14 at 2.34.29 PM.png (564×714 px, 46 KB)

Sgs changed the task status from Open to In Progress.Feb 15 2022, 10:29 AM
Sgs claimed this task.

Hi @RHo, should an arrow be added to the top corner of the module as well (similar to other modules where the entire container is a tap target)?

Screen Shot 2022-02-14 at 2.34.29 PM.png (564×714 px, 46 KB)

Yes, sorry the arrow should be back as well

image.png (298×704 px, 30 KB)

Yes, sorry the arrow should be back as well

image.png (298×704 px, 30 KB)

Should we revert to having a header with Suggested edits and a sub-header with 1 of 1 suggestions text like in the image above?

The current status quo is there's only one header. 1 of 1 suggestions when there are suggestions and Suggested edits when there aren't:

Screenshot 2022-02-15 at 17.43.44.png (470×772 px, 37 KB)
Screenshot 2022-02-15 at 17.49.42.png (450×760 px, 40 KB)

Change 762873 had a related patch set uploaded (by Sergio Gimeno; author: Sergio Gimeno):

[mediawiki/extensions/GrowthExperiments@master] Newcomer tasks: revert to showing a single action to open the Suggested edits

https://gerrit.wikimedia.org/r/762873

Yes, sorry the arrow should be back as well

image.png (298×704 px, 30 KB)

Should we revert to having a header with Suggested edits and a sub-header with 1 of 1 suggestions text like in the image above?

The current status quo is there's only one header. 1 of 1 suggestions when there are suggestions and Suggested edits when there aren't:

Screenshot 2022-02-15 at 17.43.44.png (470×772 px, 37 KB)
Screenshot 2022-02-15 at 17.49.42.png (450×760 px, 40 KB)

Sorry I was lazy in providing a mock but I've now updated the task description - basically it is to revert back to the previous design with the exception of the button width update.

Change 762873 merged by jenkins-bot:

[mediawiki/extensions/GrowthExperiments@master] Newcomer tasks: revert to showing a single action to open the Suggested edits

https://gerrit.wikimedia.org/r/762873