Page MenuHomePhabricator

Improve visibility and friendliness of revert notices
Open, Needs TriagePublic

Description

With my volunteer account, I was doing some Add Link edits on de.wiki last week. @MMiller_WMF pointed out that I had an edit reverted, which I didn't know about because revert notifications default to web (no emails) and for whatever reason, I didn't tap on the notifications count.

I was thinking if we could improve the experience for newcomers who have an edit reverted. The existing notifications suffice for experienced users, but for a new editor, maybe an overlay screen explaining what happened, what it means, and what they should do next, could be useful, using the same multi-step flow as the onboarding dialogs we have for add link:

image.png (1×1 px, 297 KB)

The overlay could have an option to never show again, and would be triggered any time a new revert notification is delivered to the user.

Event Timeline

kostajh added a subscriber: RHo.

@RHo @MMiller_WMF putting this in needs discussion, mainly for you two to talk about and see if it's something you're interested in doing. Engineering-wise, this is pretty minimal effort to do, either in GrowthExperiments or in mediawiki/core. If we did it, putting it in GrowthExperiments first is probably reasonable, to gather data on its impact / interactions.

Echo notification types generally default to web only, except system messages, user rights changes and mentions, which are sent via email as well. Reverts though are disabled entirely. (See EchoHooks::onGetDefaultOptions and EchoHooks::getNewUserPreferenceOverrides.) I think the reason was a worry that they might drive users away. There were plans for an A/B test but seems like it was never performed.

@RHo @MMiller_WMF putting this in needs discussion, mainly for you two to talk about and see if it's something you're interested in doing. Engineering-wise, this is pretty minimal effort to do, either in GrowthExperiments or in mediawiki/core. If we did it, putting it in GrowthExperiments first is probably reasonable, to gather data on its impact / interactions.

Thanks for this idea @kostajh and interesting @Tgr that there was a proposed experiment. I can see the benefit, but also worry about it having the opposite effect of discouraging further edits so my inclination is to not prioritise this right now.
In terms of how we would show the additional revert user education piece, I think it work better as a guided tour type pop-up that appears over the notifications icon so that users are reminded that that is where revert notices are posted, and to keep it as a single succinct explainer message rather than multi-step flow, given this would need to be translated and configured to different wikis (that might have different ways of handling reverts that won't be easy to translate over multi-steps).

@RHo @MMiller_WMF putting this in needs discussion, mainly for you two to talk about and see if it's something you're interested in doing. Engineering-wise, this is pretty minimal effort to do, either in GrowthExperiments or in mediawiki/core. If we did it, putting it in GrowthExperiments first is probably reasonable, to gather data on its impact / interactions.

Thanks for this idea @kostajh and interesting @Tgr that there was a proposed experiment. I can see the benefit, but also worry about it having the opposite effect of discouraging further edits so my inclination is to not prioritise this right now.

Yeah, I think it is a difficult balance. I was reminded of it again when looking at this discussion on dewiki where it looks like a new user didn't see the revert notices and was temporarily banned.

If we didn't want to take on revert notices overall, perhaps this is more of a "guardrails" idea where we would either tell the user to take a break from Add-Link tasks on Special:Homepage if the last X number of Add-Link edits were reverted, or we would hide those edits from the feed and point the user towards other easy tasks?

In terms of how we would show the additional revert user education piece, I think it work better as a guided tour type pop-up that appears over the notifications icon so that users are reminded that that is where revert notices are posted, and to keep it as a single succinct explainer message rather than multi-step flow, given this would need to be translated and configured to different wikis (that might have different ways of handling reverts that won't be easy to translate over multi-steps).

Ack. Yeah a single modal might be more appropriate if it is something specific to Special:Homepage, whereas for regular revert notices that might not work so well. Although, I don't think we have guided tours on mobile, so perhaps we would need to think through that some more.