We need to re-index Serbian-language wikis after the newly refactored extra-analysis-serbian plugin and config is deployed.
Description
Details
Subject | Repo | Branch | Lines +/- | |
---|---|---|---|---|
Update Serbian Analysis Config After Plugin Refactor | mediawiki/extensions/CirrusSearch | master | +2 -2 |
Status | Subtype | Assigned | Task | ||
---|---|---|---|---|---|
Invalid | None | T174065 [FY 2017-18 Objective] Improve support for searching in multiple languages | |||
Open | None | T154511 [Tracking] Research, test, and deploy new language analyzers | |||
Resolved | TJones | T171652 Language Analysis Morphological Library Research Spike | |||
Resolved | TJones | T178926 Review Serbian Morphological Libraries | |||
Resolved | TJones | T183015 Create Serbian Elasticsearch Plugin/Analysis Chain Using Serbian Morphological Libraries | |||
Resolved | debt | T189239 Deploy initial version of the extra-analysis plugin | |||
Resolved | debt | T189265 Re-index Serbian Wikis | |||
Resolved | TJones | T196404 Re-Re-Index Serbian Wikis after refactored plugins are deployed |
Event Timeline
@Gehel, I tried to reindex srwikiquote and extra-analysis-serbian does not appear to be deployed (neither is extra-analysis-slovak):
Scanning available plugins...
analysis-hebrew, analysis-icu, analysis-smartcn, analysis-stconvert, analysis-stempel
analysis-ukrainian, experimental-highlighter, extra, ltr
I think I made a second mistake and failed to merge the new config, too—but one catastrophe at a time. Are the serbian and slovak plugins actually installed on eqiad?
srwikiquote is currently not using the Serbian stemmer/transliterator.
@Gehel, Erik pointed me in the right direction to identify part of the problem. It looks like elastic1041 and elastic1043 still have extra-analysis installed and not extra-analysis-serbian and extra-analysis-slovak.
I poked at the clusters, elastic1041 and 1043 don't seem to have the new plugin.
A version check from dpkg confirms the new package version wasn't installed:
Correct version:
ebernhardson@elastic1020:~$ dpkg -s wmf-elasticsearch-search-plugins | grep Version Version: 5.5.2-5~jessie
Wrong version:
ebernhardson@elastic1041:/usr/share/elasticsearch/plugins$ dpkg -s wmf-elasticsearch-search-plugins | grep Version Version: 5.5.2-3~jessie
Change 437483 had a related patch set uploaded (by Tjones; owner: Tjones):
[mediawiki/extensions/CirrusSearch@master] Update Serbian Analysis Config After Plugin Refactor
Change 437483 merged by jenkins-bot:
[mediawiki/extensions/CirrusSearch@master] Update Serbian Analysis Config After Plugin Refactor
Moving this back to "In Progress" to do the actual re-indexing. Need to wait for the patch to make it to production, then it's time to re-index!
Mentioned in SAL (#wikimedia-operations) [2018-06-18T02:27:48Z] <Trey314159> reindexing Serbian wikis on elastic@codfw (T196404)
Mentioned in SAL (#wikimedia-operations) [2018-06-18T18:41:18Z] <Trey314159> reindexing Serbian wikis on elastic@eqiad (T196404)