Page MenuHomePhabricator

[S] Add Satisfaction Indicators to Semantic Excerpts in Hybrid Search
Open, MediumPublic3 Estimated Story Points

Description

User Story

As a reader using Hybrid Search, I want to indicate whether a semantically retrieved excerpt was helpful, and receive clear confirmation that my feedback was recorded, so that I feel confident my input matters.

Description

Add satisfaction indicators (thumbs up / thumbs down) to semantically retrieved excerpt cards in the Hybrid Search results.

When a user selects an indicator:

  • The selected state should visually confirm the interaction
  • An event should be sent capturing the feedback in context

This feedback supports evaluation of semantic relevance and perceived usefulness without interrupting the reading flow.

Requirements

Indicator Display

  • Each semantic excerpt card includes:
    • Thumbs up and thumbs down affordances
  • Indicators are visible but unobtrusive
  • Indicators appear only on semantic results, not lexical results

Interaction Behavior

  • When a user taps thumbs up or thumbs down:
    • The selected icon becomes filled (or otherwise visually confirmed)
    • The unselected icon remains unfilled
  • Only one selection (up or down) can be active per excerpt
  • Re-tapping the same indicator toggles it off and sends new event
  • Feedback interaction does not navigate away from results

Logging

A data event is sent on selection that includes:

  • Query identifier
  • Experiment variant (A/B/C)
  • Result type (semantic)
  • Excerpt identifier
  • Feedback value (up / down)

Logging can happen in Instrumentation task

Scope

  • Applies only to users in the Hybrid Search experiment
  • Control group does not see satisfaction indicators

Design:

Design in Figma

Demo of feedback behaviour (gif):

feedback-behaviour.gif (1×714 px, 1 MB)

Event Timeline

JTannerWMF renamed this task from Add Satisfaction Indicators to Semantic Excerpts in Hybrid Search to [S] Add Satisfaction Indicators to Semantic Excerpts in Hybrid Search.Jan 6 2026, 9:56 PM
JTannerWMF updated the task description. (Show Details)
Dbrant set the point value for this task to 3.Jan 12 2026, 6:27 PM
JTannerWMF triaged this task as Medium priority.Tue, Jan 27, 5:42 PM

Design QA punchlist created - double-checking with Haley before posting it here.

All good! Reviewed it in app and latest change via screenshot by Cooltey!