Maniphest T202173

Create Esperanto Analysis Chain using new Esperanto Plugin
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	TJones
	Aug 17 2018, 9:20 PM

Description

~~Until the upgrade to ES 6 is complete (T194199, etc.), it's difficult to work on the Esperanto Analysis chain, so I've separated this out as a distinct task.~~

David kindly back-ported the Esperanto ES6 plugin to ES5, so it's possible to test an analysis chain in ES5; it shouldn't change for ES6. Depending on our ES6 timeline, we may or may not deploy the ES5 version of the plugin and enable Esperanto analysis before the ES6 migration.

Details

	Subject	Repo	Branch	Lines +/-
	Enable Esperanto Analysis Chain	mediawiki/extensions/CirrusSearch	master	+281 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Invalid	None	T174065 [FY 2017-18 Objective] Improve support for searching in multiple languages
Open	None	T154511 [Tracking] Research, test, and deploy new language analyzers
Resolved	TJones	T171652 Language Analysis Morphological Library Research Spike
Resolved	TJones	T197240 Review Esperanto Morphological Libraries
Resolved	TJones	T200099 Create Esperanto Elasticsearch Plugin Using Esperanto Morphological Libraries
Resolved	TJones	T202173 Create Esperanto Analysis Chain using new Esperanto Plugin
Resolved	TJones	T202662 Esperanto Stemmer Updates
Resolved	TJones	T203005 Re-index Esperanto Wikis

Event Timeline

TJones triaged this task as Medium priority.Aug 17 2018, 9:20 PM

TJones created this task.

TJones moved this task from Incoming to not in use - please delete on the Discovery-Search (Current work) board.Aug 21 2018, 2:41 PM

TJones updated the task description. (Show Details)Aug 21 2018, 2:46 PM

After the fixes from T202662, everything looks good. I've created a new analysis chain, adding the stemmer and ICU folding. Detailed write up on MediaWiki.

Next Steps:

Upload a patch with the new Esperanto analysis chain, including the Esperanto stemmer and the ICU folding (see new patch below)
Wait for the Esperanto stemmer plugin to be deployed (the version for Elasticsearch 5 will probably be deployed, but there is a small chance we have to wait for the Elasticsearch 6 version).
Re-index Esperanto-language wikis to enable the new analysis chain.