Page MenuHomePhabricator
Create Task
Maniphest T325390

Suggested edits: Improve UX for "and" filtering leading to no suggestions found
Closed, ResolvedPublic
Actions

Description

User story:
As a newcomer using the homepage, I want to receive suggested edits that are relevant to topics I'm interested in, because when I don't receive any suggestions I generally don't fix the filters or return to the wikis.

Description

In initial analysis T305406: Newcomer tasks: quick analysis of AND selection usage we find:

  • A significant number of users are trying out this feature: 11.8% of users on desktop and 6.5% of users on mobile across the wikis where the feature was deployed.
  • A large proportion of users who try out the feature end up in a state where zero suggested tasks are available, and of these the vast majority do not fix the issue.

We should likely improve the UX further before, or soon after, we release T305408: Newcomer tasks: deploy AND selection to all wikis.

Current "zero suggested tasks" empty state:

Screen Shot 2022-12-16 at 11.08.22 AM.png (1×1 px, 325 KB)

Questions:

  • Should we consider a solution that helps in any scenario in which no suggested edits are shown? AKA no suggested edits resulting from "and" filtering, a topic with no results, a task type with no results.
  • Should we consider a change to the "Select topics" dialog? For example, if a user is using AND filtering and the user adds a topic filter that results in 0 results, should we disable the Done button, and show text to the user explaining that they should change the AND filter or deselect the last topic.
  • Should the empty state have a simple CTA to switch to "or" filtering? (Although most people just expect search to work and don't think much about "and"/"or" filtering, so finding the right language might be a challenge).
  • Should we automatically switch the user back to "or" filtering if they receive no results from an "and" query? And display something like:

It looks like there aren't any articles that match all of those topics, here are some articles that match at least one the topics that interest you.

Acceptance Criteria
Given I'm a newcomer,
When I use "and" filtering and don't receive suggested edits,
Then TBD (there is newcomer-friendly UX that doesn't feel like such a "dead end")

Related Objects
Search...

Event Timeline

KStoller-WMF created this task.Dec 16 2022, 7:43 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptDec 16 2022, 7:43 PM
KStoller-WMF assigned this task to RHo.Dec 16 2022, 7:43 PM
KStoller-WMF moved this task from Incoming to Needs Design/Design Doing on the Growth-Team (Sprint 0 (Growth Team)) board.
KStoller-WMF triaged this task as Medium priority.Dec 19 2022, 9:47 PM
kostajh subscribed.Dec 20 2022, 9:21 AM

One relatively straightforward intervention would be:

  • if the user is using AND filtering
  • and the user adds a topic filter that results in 0 results
  • disable the Done button, and show text to the user explaining that they should change the AND filter or deselect the last topic

image.png (1×1 px, 290 KB)

One thing this made me think about is that it might be an improved UX to have the ability to adjust topics and tasks in the same dialog. There might not be any tasks for "Art" + "Technology" and copyedit task type, but maybe there would be if the user switched to e.g. image-recommendation. With my proposal to disabling "Done" when no topics are found, the user would have to uncheck the previous topic and save (or cancel), open the task type dialog, add more task types, then go back to the topic dialog.

Another thing we could think about is prefetching data about how many results exist and placing that in the label for each topic, and disabling any topics where there isn't an intersection. That would involve making 38 requests (well, 38 * 6 task types = 190 requests to ElasticSearch), which seems kind of extreme.

With that set up, there's a case where there might not be an intersection of topics for the selected task types, so the user would have to

Sgs subscribed.Dec 20 2022, 3:04 PM
KStoller-WMF updated the task description. (Show Details)Dec 20 2022, 6:40 PM
Trizek-WMF subscribed.Jan 4 2023, 2:42 PM
RHo added a comment.Jan 5 2023, 12:06 PM

Similar to @kostajh, I propose limiting the improvement in this task to be as minimal as possible to get people back to seeing results, such as adding a CTA to go back to "match any" directly in the no results screen, if we are to roll out the feature further.
Having said that, part of the reason for the assessment task T305406 was concern about introducing the relatively complex idea of enabling switching between AND vs OR filtering method for the average user, which seems to have proven in the high number of folks not fixing the zero results issues. What if, instead of rolling out this filtering type any further, we address the core user need of being able to find more relevant results by working on T297117: Newcomer tasks: Provide more granular/advanced topic filtering for people with specific topics?

kostajh added a subtask: T326579: Suggested edits topic dialog: Disable save when in AND mode, and no results are found.Jan 9 2023, 5:41 PM
In T325390#8480715, @kostajh wrote:

One relatively straightforward intervention would be:

  • if the user is using AND filtering
  • and the user adds a topic filter that results in 0 results
  • disable the Done button, and show text to the user explaining that they should change the AND filter or deselect the last topic

Filed as T326579: Suggested edits topic dialog: Disable save when in AND mode, and no results are found

RHo mentioned this in T326579: Suggested edits topic dialog: Disable save when in AND mode, and no results are found.Jan 9 2023, 5:54 PM
KStoller-WMF closed this task as Resolved.Feb 1 2023, 6:25 PM

@RHo - it sounds like the conclusion of this task is:

Short term: T326579: Suggested edits topic dialog: Disable save when in AND mode, and no results are found
Long term: work on more extensive filtering improvements: T297117: Newcomer tasks: Provide more granular/advanced topic filtering for people with specific topics. This is work we should consider once we move to Language -agnostic topic classification.

So I think we can consider this task resolved, correct? If you don't agree, feel free to reopen.

RHo mentioned this in T322386: Leveling up: "Try a new task" dialog.Feb 4 2023, 6:27 PM
Sgs changed the status of subtask T326579: Suggested edits topic dialog: Disable save when in AND mode, and no results are found from Open to In Progress.Feb 7 2023, 5:25 PM
• nettrom_WMF mentioned this in T305406: Newcomer tasks: quick analysis of AND selection usage.Feb 15 2023, 5:24 PM
RHo mentioned this in T305408: Newcomer tasks: deploy AND selection to all wikis.Feb 24 2023, 12:47 PM
RHo closed subtask T326579: Suggested edits topic dialog: Disable save when in AND mode, and no results are found as Resolved.Mar 27 2023, 1:26 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits