Add stats marker to wikidata entity search
Closed, ResolvedPublic
Actions

Description

Most ES queries carry stats markers - usually dependent on syntax, etc., such as full_text. We should add such marker to wikidata entity search requests too, for better stats collecting.

Related Objects
Search...

Status	Assigned	Task
Resolved	Wikidata-bugs	T77898 query taking 10s: TermSqlIndex::getMatchingIDs
Open	None	T46529 Wikidata search problems (tracking)
Resolved	aude	T110648 [Bug] high-ranking items seemed to have dropped significantly in Special:Search results for wikidata
Resolved	Smalyshev	T119067 Adjust rescoring config for Wikidata to consider sitelink count
Resolved	aude	T119066 Add sitelink count to search index for Wikidata
Resolved	None	T120217 [Task] Add CirrusSearch and Elastica as dependencies of Wikibase on Jenkins
Invalid	None	T161334 Stemming for item suggestions, e.g. "the" vs. no "the" on Wikidata
Resolved	Smalyshev	T78157 [Story] Use ElasticSearch for entity search on wikidata.org
Resolved	Lydia_Pintscher	T88535 [Task] Investigate preconditions & constraints for using Elastic directly
Duplicate	Smalyshev	T117520 Index Wikidata labels, aliases and descriptions as separate fields in ElasticSearch
Duplicate	None	T117522 Create standard "completion suggestion" API for Search
Declined	None	T120089 Add an internal completion or suggestions API to core SearchEngine
Declined	None	T170392 Create gadget that enables the use of the elastic search backend for the entity selector
Resolved	daniel	T170400 Define metrics for search result quality for the entity selector widget on wikidata.
Resolved	Lydia_Pintscher	T170405 Manually evaluate cirrus based entity search on test system
Open	None	T170547 Metrics to evaluate new search for item suggestor
Declined	None	T170549 Provide A/B test for item suggestor
Resolved	Smalyshev	T162292 Reindex wikidata to pick up labels/descriptions mappings
Resolved	Smalyshev	T175199 Index certain statements for Wikidata items
Declined	None	T141813 Add full-text search support to Query Service
Resolved	Smalyshev	T125500 [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch
Resolved	dcausse	T160926 Make noop script be able replace whole fields with nested subfields
Resolved	dcausse	T166589 Update wikidata code to take advantage of nested fields noop script
Resolved	debt	T172422 Add stats marker to wikidata entity search
Resolved	Smalyshev	T178851 Use label & description index for fulltext search
Resolved	Smalyshev	T176903 Index wikidata descriptions
Resolved	Smalyshev	T180169 Make list of languages where using stemmed analyzer for Wikibase is beneficial
Resolved	Smalyshev	T182271 Wikidata fulltext search should handle search syntax properly
Resolved	dcausse	T182293 Tune wikidata fulltext search similarity parameters

Event Timeline

Smalyshev created this task.Aug 3 2017, 6:32 PM

Restricted Application added subscribers: PokestarFan, Aklapper. · View Herald TranscriptAug 3 2017, 6:32 PM

Smalyshev triaged this task as Normal priority.Aug 3 2017, 6:32 PM

Smalyshev added a parent task: T125500: [Epic] Index Wikidata labels and descriptions as separate fields in ElasticSearch.

Smalyshev added a project: User-Smalyshev.Aug 4 2017, 9:07 PM

Smalyshev moved this task from Backlog to Next on the User-Smalyshev board.Aug 4 2017, 9:47 PM

Smalyshev moved this task from Next to Doing on the User-Smalyshev board.Aug 8 2017, 11:54 PM

Change 370763 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[mediawiki/extensions/Wikibase@master] Add stats parameter for search query, for ES tracking

https://gerrit.wikimedia.org/r/370763

gerritbot added a project: Patch-For-Review.Aug 9 2017, 12:01 AM

Smalyshev moved this task from Doing to Waiting/Blocked on the User-Smalyshev board.Aug 9 2017, 12:19 AM

Change 370763 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Add stats parameter for search query, for ES tracking

https://gerrit.wikimedia.org/r/370763

Smalyshev moved this task from needs triage to Current work on the Discovery-Search board.Aug 9 2017, 7:07 AM

Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery-Search.

Smalyshev moved this task from in progress to Done on the Discovery-Search (Current work) board.

Smalyshev removed projects: Patch-For-Review, User-Smalyshev.

debt closed this task as Resolved.Aug 14 2017, 6:50 PM

debt claimed this task.