Page MenuHomePhabricator

Explore tools and processes for user testing for mobile web
Open, MediumPublic

Description

This task requires further scoping.

  • [Leila and Bethany] Discuss with potential stakeholders to better understand needs or potential change in needs for testing on mobile starting FY26. (Leila sends the email to stakeholders in January)

Summary of findings as of 28 Mar 2025:

Leila and I did not discover any imminent needs regarding mobile testing. However, a conversation Carolyn revealed an ongoing challenge for testing on Apps: there is no beta cluster for the apps, making it nearly impossible to test anything that has editing implications. When they use testwiki, it creates problems with moderators that aren't easily overcome.

Aside from this conversation, we did not hear any other challenges or upcoming needs. I began to explore Lookback as a potential tool for a better moderated mobile/app testing experience. It has potential, but as of this time, I have not heard any demand for an additional tool for moderated testing.

Event Timeline

leila triaged this task as Medium priority.Jan 29 2025, 6:59 PM

Attended a demo for Lookback.com, which is supposed to be a user testing platform optimized for mobile testing. I submitted a $0 BAR for legal & security review so that we can play around with the free trial. I researched out to Design to see who could test the platform.

Spoke with Carolyn about challenges with testing (particularly editing) on mobile. Seems like one of the big challenges cannot be solved by a 3rd party tool, and would need internal engineering support or perhaps a community relations-led effort. It does seem like there could be an opportunity to establish a program around this need.

This comment was removed by Bethany.

Bethany and I talked about this task on March 26th. We agreed that the best outcome is to use the learnings we have had during this quarter and scope the task for a future in which we may want to pick it up. Moving to to Backlog for us to scope it there.