Maniphest T125825

Extract a set of full_text "ambiguous" queries from hive
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	dcausse
	Feb 4 2016, 2:55 PM

Tags

Referenced Files

None

Subscribers

Description

We need to extract a set of ambiguous queries (that return more than 1000 results for enwiki)
Ideally we need :

a set with basic queries (no special syntax, no phrase search)
a set with single word queries
a set with multi word queries

We should carefully exclude queries from the WikipediaApp since they include partial words (search as you type) which will pollute the set.

Details

	Subject	Repo	Branch	Lines +/-
	hive query to extract sample query set	wikimedia/discovery/relevancylab	master	+94 -0

Customize query in gerrit

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		• Deskana	T125603 EPIC: Review current ElasticSearch configuration, and use relevance lab to run tests to optimise the configuration to improve search result relevance
		Resolved		dcausse	T125083 Evaluate the "boosted all field"
		Resolved		dcausse	T125825 Extract a set of full_text "ambiguous" queries from hive

Event Timeline

dcausse created this task.Feb 4 2016, 2:55 PM

dcausse raised the priority of this task from to Medium.

dcausse updated the task description. (Show Details)

dcausse added projects: Discovery-Search (Current work), Discovery-ARCHIVED, CirrusSearch.

dcausse added subscribers: Aklapper, StudiesWorld, dcausse.

dcausse claimed this task.Feb 4 2016, 5:55 PM

dcausse set Security to None.

dcausse moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.

Change 268704 had a related patch set uploaded (by DCausse):
hive query to extract sample query set

https://gerrit.wikimedia.org/r/268704

gerritbot added a project: Patch-For-Review.Feb 5 2016, 5:44 PM

Queries are available on stat1002.eqiad.wmnet:~dcausse/query_sets/

dcausse moved this task from not in use - please delete to Needs review on the Discovery-Search (Current work) board.Feb 5 2016, 6:34 PM

EBernhardson moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Feb 8 2016, 8:03 PM

Change 268704 merged by jenkins-bot:
hive query to extract sample query set

https://gerrit.wikimedia.org/r/268704

EBernhardson moved this task from Needs triage to Search on the Discovery-ARCHIVED board.Feb 11 2016, 11:20 PM

• Deskana closed this task as Resolved.Feb 17 2016, 5:18 PM

• Deskana subscribed.