Page MenuHomePhabricator

Sister project snippets: investigate updating algorithm for longer queries and grouping logical words
Closed, DeclinedPublic

Description

When doing a search such as 'how old is George Bush' maybe we can lower the weighting of searching for each word and look for the important words in the query.

ie: instead of looking for 'how' and 'old' and 'is' and 'George' and 'Bush' maybe we can do a better job of searching for the more important words in the query: 'old' and 'George Bush'

how-old-is-george-bush_sister_projects.png (942×858 px, 356 KB)

Event Timeline

debt lowered the priority of this task from Medium to Low.Jul 6 2017, 5:14 PM
debt moved this task from needs triage to This Quarter on the Discovery-Search board.

Maybe we can edit the custom highlighter to downplay the 'is' and 'how' in the snippet (as long as the snippet wasn't chosen for those words)? But, @dcausse would probably know best.

Yes the highlighter can be tuned with many different options but good highlighting is almost as hard as search relevance itself :)
I don't have quick options I could activate and this task can rapidly become a rabbit hole. Given the priority I'd prefer to wait and group together the tasks related to highlighting so we can have a bigger overview of the direction we want to go.

MPhamWMF subscribed.

Closing out low/est priority tasks over 6 months old with no activity within last 6 months in order to clean out the backlog of tickets we will not be addressing in the near term. Please feel free to reopen if you think a ticket is important, but bare in mind that given current priorities and resourcing, it is unlikely for the Search team to pick up these tasks for the indefinite future. We hope that the requested changes have either been addressed by or made irrelevant by work the team has done or is doing -- e.g. upgrading Elasticsearch to a newer version will solve various ES-related problems -- or will be subsumed by future work in a more generalized way.

RhinosF1 removed a project: Discovery-Search.
RhinosF1 subscribed.

Re-opening tasks and removing from team workboard per IRC feedback given yesterday and discussion with MPham.

declining, as I don't think there is a straightforward way to determine which words are more important without also being able to have smarter natural language understanding that can try to answer the question more directly