Page MenuHomePhabricator

Add full-text search support to Query Service
Closed, DeclinedPublic

Description

Currently, Query Service has limited capability to search through the data, due to absence of support for FTS engine. We did not add this capability, since we already have FTS implementation in ElasticSearch - however, we do not actually use it from Blazegraph.

Blazegraph allows to plug in external search engines: https://wiki.blazegraph.com/wiki/index.php/ExternalFullTextSearch

We should develop a capability to use our search from inside Blazegraph, there are a number of requests for queries that include searching and right now they are not running efficiently due to inability to leverage ElasticSearch.

Current workaround: use SQL on quarry.wmflabs.org

Related Objects

StatusSubtypeAssignedTask
DeclinedNone
ResolvedSmalyshev
InvalidNone
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
Resolved dcausse
Resolved dcausse
ResolvedSmalyshev
Resolveddebt
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
ResolvedSmalyshev
Resolved dcausse
ResolvedSmalyshev

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Sample syntax from T144280:

  SERVICE wikibase:sitesearch { 
		?item wdt:P31 ?instance .
      bd:serviceParam wikibase:searchsite "wikidatawiki"  . 
      bd:serviceParam wikibase:searchterm "John Doe"  . 
      bd:serviceParam wikibase:searchlang "en"  . 
      bd:serviceParam wikibase:searchresultlimit "500" . 
      bd:serviceParam wikibase:searchresultoffset "10" . 
  }
thiemowmde added a subscriber: Jonas.
Smalyshev raised the priority of this task from Low to Medium.Sep 12 2016, 10:46 PM

The current solution works for me. Thanks!

Given that you can use MWAPI to run fulltext search over any wiki (including Wikidata) I am not sure we need another implementation in Blazegraph...

Lydia_Pintscher added a subscriber: Lydia_Pintscher.

Agreed. Let's close this and if someone has a good reason to reopen it please do so.