Page MenuHomePhabricator

Investigate how to warn users about the shortcomings of Category search (and categories)
Open, Needs TriagePublic

Description

The main problem with categories is well known to experienced Wikimedians but will be quite counter-intuitive for normal users. Namely, in a typical subject scheme, topmost categories like Art or Science or History would contain the most entires. Searching on these would yield the most results. But in the wikis, these categories often contain only other categories and no articles. So searching on them will yield no results. Frustration will ensue as users will conclude the feature is broken.

In T158572 we explored how to mitigate this issue, but found no solutions. So it seems to me that the least we can do is to somehow inform users of the issue. I'm not sure what the best way to do this is. Here are some initial thoughts:

  • Include a very prominent and descriptive link to a help page. Not just a "?", but something more like: How to get results or Quirks of this feature or How to make this work
  • Add an error message when the user gets no (or very few) results, saying something like: "No results found. You may be searching in too broad a cateogory. Learn the quirks of this feature and how to get results.
  • The problem with the above idea is that the user might get SOME results, so not realize they aren't really getting what they think they are. Is there a way to detect when a category has fewer than, what, ten articles?
  • Perhaps, whatever else we do, we should also label the feature "experimental" or "beta" or something.

Event Timeline

@Mooeypoo asked for some examples of the problem with Category searches. Here are a few that illustrate the general randomness.

Fixing some of it may be pretty complex; we could start with maybe suggesting a couple of the sub-categories, but we can't descend to sub-sub-sub-etc because of technical insanities.

To start, we can add a help popup for "Categories" similar to what we currently have with ORES filters? Something that explains the caveats of categories. To that, we can then later consider adding more features like sub categories, or warnings for empty categories, etc.

In any case, some of these will have to be a sort of "phase 2" of the GSoC project. Let's try and come up with what we would like to see work best, and then we can prioritize and see which would fit the current project scope, and which would have to be prioritized to the 2nd phase of the MVP.

I agree we want to communicate these circumstances better, but I also think it is ok to do it iteratively and I'd not consider it a blocker for the initial category support (Related Changes has already similar limitations).

Some thoughts:

  • We may want to explain limitations only when they are relevant. We can inform of the limitations right after the user added a category which is composed of sub-categories that are not added automatically. Conversely, if the user selects a simple category with no sub-categories we may not need to add further distraction.
  • Surfacing some of the sub-categories (not descending further to sub-sub-categories), can be a positive way to convey the message that these are not included automatically.
  • For redirects, we may want to treat them as if they were the category they are redirecting to.

I can add some mockups to illustrate these ideas better.

I illustrated the idea of showing a follow-up action as a way to communicate that subcategories are not included automatically, and facilitate adding them.

InitialAfter selecting a category which has subcategories
RC-subcat-initial.png (768×1 px, 204 KB)
subcat-followup.png (768×1 px, 207 KB)
  • Categories are displayed as a simple list initially.
  • If the user selects a category which contains subcategories, an information area is shown below the selected item.
  • This area asks users if they want to include sub-categories, surfacing up to two subcategories and a "more" option that goes to the category page (opening in a new tab/window) where the user can explore the existing sub-categories.

The goal is to add categories, or replace the chosen one?

The goal is to add categories, or replace the chosen one?

The idea is to add additional categories.

One of the goals to narrow the results and avoid null results would be to suggest a replacement, so that results displayed would be more precise.

Re. the design below:

subcat-followup.png (768×1 px, 207 KB)

This is promising, but i was thinking of something clumsier but perhaps simpler. There are 35 subcategories in Science. There are 34 in History, and 39 in Technology. These are too many, clearly, to put in the menu/ But theses lists are not too long to put into a box at the top of the results area. This use of space might be justified by the additional clarity it would provide. And if we're worried about the space, we can make it collapsible.

Vvjjkkii renamed this task from Investigate how to warn users about the shortcomings of Category search (and categories) to occaaaaaaa.Jul 1 2018, 1:08 AM
Vvjjkkii triaged this task as High priority.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed a subscriber: Aklapper.
CommunityTechBot renamed this task from occaaaaaaa to Investigate how to warn users about the shortcomings of Category search (and categories).Jul 2 2018, 3:51 PM
CommunityTechBot raised the priority of this task from High to Needs Triage.
CommunityTechBot updated the task description. (Show Details)
CommunityTechBot added a subscriber: Aklapper.