Page MenuHomePhabricator
Create Task
Maniphest T215594

Fix and add integration tests for language analyzers
Closed, ResolvedPublic
Actions

Description

Analysis components can be declared as prebuilt or configurable, prebuilt version are the most efficient as they are prebuilt and a single instance of the factory is present in mem but they are not usable as a custom tokenfilter.
This task is about unifying how we declare token filters possibly only using prebuilt token filters.

Details

SubjectRepoBranchLines +/-
Use prebuilt slovak stemmermediawiki/extensions/CirrusSearches6+3 -10
Use prebuilt serbian_stemmermediawiki/extensions/CirrusSearches6+9 -25
Add prebuilt version of the slovak stemmersearch/extramaster+117 -0
Add integration tests for esperanto_stemmersearch/extra-analysismaster+82 -0
Add serbian_stemmer as a configurable token filtersearch/extra-analysismaster+142 -1
Use prebuilt serbian_stemmermediawiki/extensions/CirrusSearchmaster+9 -25
Use prebuilt slovak stemmermediawiki/extensions/CirrusSearchmaster+3 -10
Customize query in gerrit

Event Timeline

dcausse created this task.Feb 8 2019, 10:47 AM
Restricted Application edited projects, added Discovery-Search; removed Discovery-Search (Current work). · View Herald TranscriptFeb 8 2019, 10:47 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript
dcausse claimed this task.Feb 8 2019, 10:47 AM
dcausse triaged this task as Medium priority.
dcausse edited projects, added Discovery-Search (Current work); removed Discovery-Search.
gerritbot subscribed.Feb 8 2019, 10:48 AM

Change 489177 had a related patch set uploaded (by DCausse; owner: DCausse):
[search/extra-analysis@master] Add serbian_stemmer as a configurable token filter

https://gerrit.wikimedia.org/r/489177

gerritbot added a project: Patch-For-Review.Feb 8 2019, 10:48 AM
gerritbot added a comment.Feb 8 2019, 10:53 AM

Change 489179 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/CirrusSearch@master] Use prebuilt serbian_stemmer

https://gerrit.wikimedia.org/r/489179

gerritbot added a comment.Feb 8 2019, 11:09 AM

Change 489182 had a related patch set uploaded (by DCausse; owner: DCausse):
[search/extra-analysis@master] Add integration tests for esperanto_stemmer

https://gerrit.wikimedia.org/r/489182

gerritbot added a comment.Feb 8 2019, 1:23 PM

Change 489201 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/CirrusSearch@master] Use prebuilt slovak stemmer

https://gerrit.wikimedia.org/r/489201

gerritbot added a comment.Feb 8 2019, 1:28 PM

Change 489202 had a related patch set uploaded (by DCausse; owner: DCausse):
[search/extra@master] Add prebuilt version of the slovak stemmer

https://gerrit.wikimedia.org/r/489202

dcausse moved this task from Incoming to Needs review on the Discovery-Search (Current work) board.Feb 8 2019, 2:01 PM
gerritbot added a comment.Feb 8 2019, 2:17 PM

Change 489215 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/CirrusSearch@es6] Use prebuilt serbian_stemmer

https://gerrit.wikimedia.org/r/489215

gerritbot added a comment.Feb 8 2019, 2:17 PM

Change 489216 had a related patch set uploaded (by DCausse; owner: DCausse):
[mediawiki/extensions/CirrusSearch@es6] Use prebuilt slovak stemmer

https://gerrit.wikimedia.org/r/489216

gerritbot added a comment.Feb 8 2019, 2:18 PM

Change 489201 abandoned by DCausse:
Use prebuilt slovak stemmer

Reason:
wrong branch

https://gerrit.wikimedia.org/r/489201

gerritbot added a comment.Feb 8 2019, 2:18 PM

Change 489179 abandoned by DCausse:
Use prebuilt serbian_stemmer

Reason:
wrong branch

https://gerrit.wikimedia.org/r/489179

gerritbot added a comment.Feb 8 2019, 3:02 PM

Change 489202 merged by jenkins-bot:
[search/extra@master] Add prebuilt version of the slovak stemmer

https://gerrit.wikimedia.org/r/489202

gerritbot added a comment.Feb 8 2019, 3:02 PM

Change 489177 merged by jenkins-bot:
[search/extra-analysis@master] Add serbian_stemmer as a configurable token filter

https://gerrit.wikimedia.org/r/489177

gerritbot added a comment.Feb 8 2019, 3:06 PM

Change 489182 merged by jenkins-bot:
[search/extra-analysis@master] Add integration tests for esperanto_stemmer

https://gerrit.wikimedia.org/r/489182

gerritbot added a comment.Feb 8 2019, 3:23 PM

Change 489215 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@es6] Use prebuilt serbian_stemmer

https://gerrit.wikimedia.org/r/489215

gerritbot added a comment.Feb 8 2019, 3:24 PM

Change 489216 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@es6] Use prebuilt slovak stemmer

https://gerrit.wikimedia.org/r/489216

dcausse moved this task from Needs review to Needs Reporting on the Discovery-Search (Current work) board.Feb 18 2019, 4:51 PM
dcausse removed a project: Patch-For-Review.
debt closed this task as Resolved.Feb 22 2019, 8:51 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL