Page MenuHomePhabricator

Conduct usability study: First suggestion discoverability when entering Edit mode regardless of viewport position
Closed, ResolvedPublic

Description

Background

We need to ensure people notice the first suggestion when entering Edit mode, specifically in the case when it’s outside their initial viewport. This task is to evaluate proposed solution in T414518.

Captura de pantalla 2026-02-04 a las 12.42.18.png (374×668 px, 99 KB)

Decisions to be made

  • Do users clearly notice that suggestions are available when entering Edit mode, even if none are visible in their initial viewport? - Yes
  • Do users clearly understand the solution when entering Edit mode from any section of the article? - Yes
  • Is the entry point understood as an actionable element that takes users to the first suggestion? - Yes
  • Does jumping to the first suggestion feel predictable and helpful, or disorienting? - Yes
  • Is the solution non-intrusive for users who enter Edit mode with a specific editing goal? - yes
  • Do users clearly understand when there are no more suggestions to address? - Yes
  • Does this solution offer the balance between clarity, non-intrusiveness, and predictability when discovering suggestions? - Yes
  • Are there any UX adjustments needed (copy, placement, affordances) before moving forward? - Improvements found will be included in T414518

Usability testing findings

Acceptance criteria (or Done)

  • Conduct usability test and analyze results
  • Decide on what (if any) adjustments will we make to T414518

Future tasks

Event Timeline

bmartinezcalvo renamed this task from Conduct usability study: First suggestion discoverability when entering Edit mode regardless of viewport position to Conduct usability study: First suggestion discoverability regardless of viewport position.Feb 2 2026, 2:05 PM
bmartinezcalvo renamed this task from Conduct usability study: First suggestion discoverability regardless of viewport position to Conduct usability study: First suggestion discoverability when entering Edit mode regardless of viewport position.Feb 2 2026, 2:26 PM

Any chance we could try a non-banner option as well? It feels like we're stacking the deck there.

El T415933#11575432, @DLynch escribió:

Any chance we could try a non-banner option as well? It feels like we're stacking the deck there.

I considered about a non-banner option as well. But the main alternative I see would be automatically scrolling users to the first suggestion when turning suggestions on or when entering edit mode and suggestions are already on. However, this feels quite intrusive, especially for editors who enter Edit mode with a specific change in mind, since it moves them away from the section they intentionally chose without an explicit action.

Given our goal of keeping the experience non-disruptive while still making suggestions discoverable, an explicit entry point feels like the better approach, as it informs users and leaves control on them rather than forcing navigation.

Next steps
Per today's team meeting...

  • @bmartinezcalvo: summarize test findings and document a point of view on issues that you think we ought to prioritize addressing before starting the controlled experiment of Suggestion Mode (T404600)
  • @ppelberg: to review proposal and align with Bárbara on proposal we will share with team for feedback
  • @bmartinezcalvo: share proposed path forward with team

In order to evaluate the different decisions to be made listed in this task, I conducted 2 phases of usability testing:

  • Phase 1: Identified some improvements in the initial prototype around discoverability, lack of feedback, and navigation of suggestions.
  • Phase 2: Based on the findings from Phase 1, I conducted a second round of tests with the improved prototype that included:
    • Improved the visibility of the “View suggestions” entry point to make it easier to navigate the 1st suggestion
    • Displayed sequential navigation (up/down arrows) once scrolling to help users move between remaining suggestions.
    • Introduced contextual Toasts to:
      • Confirm when suggestions are turned on/off (to avoid users to turn them off by mistake)
      • Notify when more suggestions become available after loading the full page
      • Indicate when there are 0 suggestions available to let users know that no more suggestions need to be completed
Key findings (slides)
  • Users clearly understand the lightbulb icon and the badge meaning, associating them with suggestions/improvements for the article.
  • The "View suggestions" entry point is perceived as actionable and jumping to the first suggestion feels predictable and non-intrusive.
  • Toasts significantly improved clarity and user confidence. Task flow felt smoother, and users were able to complete actions more easily when contextual Toast feedback was present. I've created T417827: Suggestion Mode: Implement contextual Toasts to communicate state changes to implement these Toasts.
  • The main remaining friction is around efficient navigation between the suggestions across the article, especially in long articles. As this improvement goes beyond the scope of T414518, I’ve created a separate task to address it T417821: Suggestions: Include a pagination to navigate suggestions.
Next steps
  • I will update the proposal in T414518 with the UX improvements found in this test to implement that approach
  • Implement the Toasts listed on T417827. cc: @ppelberg
  • Work on T417821 to improve the navigation of all suggestions, especially for long articles on mobile. cc: @ppelberg

Solving this task since usability testing has been completed. I will review this with @ppelberg and we will share with the rest of the team once decided on next steps.