Page MenuHomePhabricator

Make search context highlights work with the ferret search engine
Open, MediumPublic

Description

According to T168061#5386265, we should see similar (actually better) search behavior by switching to Phabricator's built in search engine. It's not the same as what we used previously, the built in search has been overhauled completely since the last time we used it.

The built-in search seems to have good quality search results, however, it only shows titles in the search results. With elasticsearch we have contextual highlights to show matching words from the page body.

@epriestley mentioned in T224082#5804022 that the highlighting should be portable to ferret.

After looking at it in depth with @brennen, it looks feasible to implement context highlighting for ferret search results, however, it's not exactly straightforward. Some notes from our investigation: https://etherpad.wikimedia.org/p/phabricator-search

Event Timeline

mmodell created this task.Aug 20 2019, 10:34 AM
mmodell updated the task description. (Show Details)
mmodell triaged this task as Medium priority.Sep 4 2019, 5:13 AM
mmodell moved this task from INBOX to Soon-ish on the Release-Engineering-Team-TODO board.
mmodell moved this task from Soon-ish to 201909 on the Release-Engineering-Team-TODO board.

@brennen I think this would be a good small project for de-siloing phabricator stuff if you're interested in collaborating on this task in the coming quarter.

So the biggest difference that I can see between elastic and pherrit is that elastic supports highlighting the actual text that matched, with pherrit you don't see anything but the title of the matching documents.

mmodell renamed this task from Test out the Phabricator 'ferrit' search engine. to Test out the Phabricator 'ferret' search engine..Jan 15 2020, 12:36 AM
brennen moved this task from Backlog to In Progress on the User-brennen board.Wed, Feb 26, 5:51 PM
mmodell renamed this task from Test out the Phabricator 'ferret' search engine. to Make search context highlights work with the ferrit search engine.Wed, Feb 26, 6:30 PM
mmodell updated the task description. (Show Details)
mmodell renamed this task from Make search context highlights work with the ferrit search engine to Make search context highlights work with the ferret search engine.Wed, Feb 26, 6:33 PM
mmodell updated the task description. (Show Details)Wed, Feb 26, 6:35 PM
mmodell added a comment.EditedFri, Feb 28, 4:13 AM

@brennen: I've submitted a revision (D1179: WIP: show matching context from the document body in ferret search results), it's a rough draft, but it works... ignore the warts for now but please take a look and let me know if it's totally insane. I suspect it is at least moderately insane, however, I've had enough of this code for the time being and I wanted to give you something to look at.