The Esperanto stemmer seems to work well. The results look reasonable to me, several people have given generally positive feedback, and the questions and concerns people have had don’t indicate that the word groupings are so bad that they wouldn’t be useful, overall.
So, the next step is to create an Elasticsearch plugin based on the stemmer. This stemmer's framework is based on the Serbian stemmer we converted to a plugin before (T183015), so it is GPLv3.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| Convert Esperanto Stemmer to Elastic Plugin | search/extra-analysis | 5.x | +856 -22 | |
| Convert Esperanto Stemmer to Elastic Plugin | search/extra-analysis | master | +825 -1 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Invalid | None | T174065 [FY 2017-18 Objective] Improve support for searching in multiple languages | |||
| Open | None | T154511 [Tracking] Research, test, and deploy new language analyzers | |||
| Resolved | TJones | T171652 Language Analysis Morphological Library Research Spike | |||
| Resolved | TJones | T197240 Review Esperanto Morphological Libraries | |||
| Resolved | TJones | T200099 Create Esperanto Elasticsearch Plugin Using Esperanto Morphological Libraries | |||
| Resolved | TJones | T202173 Create Esperanto Analysis Chain using new Esperanto Plugin | |||
| Resolved | TJones | T202662 Esperanto Stemmer Updates | |||
| Resolved | TJones | T203005 Re-index Esperanto Wikis |
Change 447676 had a related patch set uploaded (by Tjones; owner: Tjones):
[search/extra-analysis@master] [WIP] Convert Esperanto Stemmer to Elastic Plugin
I was able to load this in a Elasticsearch 6 Test environment and run it, so it is no longer [WIP]. I'm separating out the analysis chain as a separate ticket since I can't easily work on it yet, since we haven't finished upgrading to ES6.
Change 447676 merged by jenkins-bot:
[search/extra-analysis@master] Convert Esperanto Stemmer to Elastic Plugin
Change 454047 had a related patch set uploaded (by DCausse; owner: Tjones):
[search/extra-analysis@5.x] Convert Esperanto Stemmer to Elastic Plugin
Change 454047 merged by jenkins-bot:
[search/extra-analysis@5.x] Convert Esperanto Stemmer to Elastic Plugin