T382454 introduced a new tool menu within the mobile visual editor's toolbar.

For now, this new tool menu will be represented by a + icon and it will contain the following tools (subject to change):

• Insert reference
• Insert function
• The tools T385851 specifies

This task represents the work of evaluating the impact of these changes so that we can make the following decision...

Decision(s) to be made

• 1. What – if any – adjustments will we make to the revised UX to ensure people can successfully publish edits at rates that are not significantly lower than they were before this change? E.g. might we revise what icon we use in the mobile VE editing toolbar to represent this new tool menu? Might we revise what tools are present within the mobile VE editing toolbar (rather than within the new + menu itself? Etc.

Open questions

[x ] 1 . Does Abstract Wikipedia think it's important to evaluate the following as part of this analysis?

• Engagement with the Insert function menu item
• The proportion of people who engage with the Insert function menu item and successfully publish an edit

Research questions

1. Do we notice a change in how likely the introduction of the new + menu within the mobile VE toolbar impacts edit success and quality, as measured by:
   • KPI: The rate at which people complete the edits they start
   • guardail: The rate at which the edits people publish are reverted
2. curiosity: Do we notice a change in how likely people are to add references with the new content they're attempting to add, as measured by:
   • Rate at which Reference Check is shown
   • Rate at which new content edits include a reference

i. We're specifying "link tool" here b/c, for now, this is the tool we're assuming we'll move from the mobile VE toolbar to the new + menu within it