Tune wikidata fulltext search similarity parameters
Closed, ResolvedPublic
Actions

Description

Wikidata uses array fields, it's likely that popular items gets more aliases, the all field is affected as well.
We know that array fields may cause troubles with length normalization causing popular items to have low score.
The plan would be to tune the BM25 b param for:

all
labels.*

and proceed as follow:
1/ reindex relforge to setup different similarities for these field
2/ tune the b param (once the similarity is set we can close the index to tune it and iterate like that)
3/ submit a patch to wmf-config to add a wikidata profile in wgCirrusSearchSimilarityProfiles

Details

Subject	Repo	Branch	Lines +/-
Extract names of search fields as constants	mediawiki/extensions/Wikibase	wmf/1.31.0-wmf.12	+47 -11
[cirrus] tune wikidata similarity configuration	operations/mediawiki-config	master	+39 -0
Extract names of search fields as constants	mediawiki/extensions/Wikibase	master	+47 -11

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Resolved	Wikidata-bugs	T77898 query taking 10s: TermSqlIndex::getMatchingIDs
Declined	None	T141813 Add full-text search support to Query Service
Open	None	T46529 Wikidata search problems (tracking)
Resolved	aude	T110648 [Bug] high-ranking items seemed to have dropped significantly in Special:Search results for wikidata
Resolved	Smalyshev	T119067 Adjust rescoring config for Wikidata to consider sitelink count
Resolved	aude	T119066 Add sitelink count to search index for Wikidata
Resolved	None	T120217 [Task] Add CirrusSearch and Elastica as dependencies of Wikibase on Jenkins
Invalid	None	T161334 Stemming for item suggestions, e.g. "the" vs. no "the" on Wikidata
Resolved	Smalyshev	T143706 Implement TermLookup based on Elastic
Resolved	Smalyshev	T78157 [Story] Use ElasticSearch for entity search on wikidata.org
Resolved	Lydia_Pintscher	T88535 [Task] Investigate preconditions & constraints for using Elastic directly
Duplicate	Smalyshev	T117520 Index Wikidata labels, aliases and descriptions as separate fields in ElasticSearch
Resolved	Smalyshev	T125500 [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch
Resolved	Smalyshev	T178851 Use label & description index for fulltext search
Resolved	dcausse	T182293 Tune wikidata fulltext search similarity parameters
Duplicate	None	T117522 Create standard "completion suggestion" API for Search
Declined	None	T120089 Add an internal completion or suggestions API to core SearchEngine
Declined	None	T170392 Create gadget that enables the use of the elastic search backend for the entity selector
Resolved	daniel	T170400 Define metrics for search result quality for the entity selector widget on wikidata.
Resolved	Lydia_Pintscher	T170405 Manually evaluate cirrus based entity search on test system
Open	None	T170547 Metrics to evaluate new search for item suggestor
Declined	None	T170549 Provide A/B test for item suggestor
Resolved	Smalyshev	T162292 Reindex wikidata to pick up labels/descriptions mappings
Resolved	dcausse	T160926 Make noop script be able replace whole fields with nested subfields
Resolved	dcausse	T166589 Update wikidata code to take advantage of nested fields noop script
Resolved	Smalyshev	T175199 Index certain statements for Wikidata items

Event Timeline

dcausse triaged this task as Medium priority.Dec 7 2017, 9:03 AM

dcausse created this task.

dcausse moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.Dec 7 2017, 10:56 AM

Smalyshev moved this task from Backlog to Waiting/Blocked on the User-Smalyshev board.Dec 12 2017, 8:42 AM

Change 397852 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/Wikibase@master] Extract names of search fields as constants

https://gerrit.wikimedia.org/r/397852

gerritbot added a project: Patch-For-Review.Dec 12 2017, 3:56 PM

Change 397855 had a related patch set uploaded (by DCausse; owner: DCausse):
[operations/mediawiki-config@master] [cirrus] tune wikidata similarity configuration

https://gerrit.wikimedia.org/r/397855

dcausse moved this task from not in use - please delete to Needs review on the Discovery-Search (Current work) board.Dec 12 2017, 4:10 PM

Change 397852 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Extract names of search fields as constants

https://gerrit.wikimedia.org/r/397852

ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2018-01-02 (1.31.0-wmf.15)).Dec 12 2017, 7:00 PM

Change 398018 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/Wikibase@wmf/1.31.0-wmf.12] Extract names of search fields as constants

https://gerrit.wikimedia.org/r/398018

Change 397855 merged by jenkins-bot:
[operations/mediawiki-config@master] [cirrus] tune wikidata similarity configuration

https://gerrit.wikimedia.org/r/397855

Mentioned in SAL (#wikimedia-operations) [2017-12-13T14:20:12Z] <dcausse@tin> Synchronized wmf-config/Wikibase.php: T182293 [cirrus] tune wikidata similarity configuration 1/2 (duration: 01m 12s)

Change 398018 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@wmf/1.31.0-wmf.12] Extract names of search fields as constants

https://gerrit.wikimedia.org/r/398018

Mentioned in SAL (#wikimedia-operations) [2017-12-13T14:22:08Z] <dcausse@tin> Synchronized wmf-config/InitialiseSettings.php: T182293 [cirrus] tune wikidata similarity configuration 2/2 (duration: 01m 07s)

Mentioned in SAL (#wikimedia-operations) [2017-12-13T14:29:58Z] <dcausse@tin> Synchronized php-1.31.0-wmf.12/extensions/Wikibase: T182293 Extract names of search fields as constants (duration: 02m 05s)