Page MenuHomePhabricator

Upgrade translatewiki elasticsearch version to 6.8.23
Closed, ResolvedPublic4 Estimated Story Points

Description

The elasticsearch cluster running behind translatewiki.net should be upgraded to 6.8.23. Reasons are:

Note that after upgrading to 6.8 all the indices should be re-indexed so that they pick-up the most recent default index settings/mappings.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

@dcausse (or anyone): do you have a timeline for WMF upgrades? I am considering this task for May, but if it blocks your work (or there is other good reason) then I would prioritize this earlier.

@Nikerabbit ideally we would like to have migrated all MW extensions depending on elasticsearch by may 13th so addressing this task in the first half of May would be ideal for us.

Nikerabbit added a subscriber: abi_.

Thanks. Because we have an off-site coming up, I'm putting this in the current sprint already. @abi_ can you estimate this task?

abi_ set the point value for this task to 4.Apr 25 2022, 12:33 PM

I'm running Elasticsearch 6.5.4 on my machine and I'll be updating it to 6.8.23

Change 787467 had a related patch set uploaded (by Abijeet Patro; author: Abijeet Patro):

[translatewiki@master] Update Elasticsearch to 6.8.23

https://gerrit.wikimedia.org/r/787467

I updated my local instance Elasticsearch from 6.5.4 to 6.8.23

  1. Disable translation memory by removing it from settings
  2. Remove Elasticsearch 6.5.4 by running sudo apt-get purge elasticsearch
  3. Grab Elasticsearch 6.8.23 deb file from https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-6.8.23.deb
  4. Install: sudo dpkg -i elasticsearch-6.8.23.deb
  5. Enable auto-start: sudo /bin/systemctl enable elasticsearch.service
  6. Start Elasticsearch: sudo systemctl start elasticsearch.service
  7. Install wikimedia-search-extra plugin: In /usr/share/elasticsearch run sudo ./bin/elasticsearch-plugin install org.wikimedia.search:extra:6.8.23-wmf1
  8. Install search-highlighter plugin: In /usr/share/elasticsearch run sudo ./bin/elasticsearch-plugin install org.wikimedia.search.highlighter:experimental-highlighter-elasticsearch-plugin:6.8.23
  9. Restart Elasticsearch - sudo systemctl restart elasticsearch.service
  10. Re-enable translation memory again
  11. Run php extensions/Translate/scripts/ttmserver-export.php from the MediaWiki core directory to bootstrap the translation memory

I did not see any issues, the update went smoothly, and I am getting suggestions from translation memory.

Change 787467 merged by jenkins-bot:

[translatewiki@master] Update Elasticsearch to 6.8.23

https://gerrit.wikimedia.org/r/787467

We had a few difficulties but we managed to complete the upgrade and reindex the search index and the translation search/memory index.

https://translatewiki.net/wiki/Special:Version

Change 793062 had a related patch set uploaded (by Abijeet Patro; author: Nikerabbit):

[translatewiki@master] Fixes for Elasticsearch upgrade

https://gerrit.wikimedia.org/r/793062

Change 793393 had a related patch set uploaded (by Nikerabbit; author: Nikerabbit):

[mediawiki/extensions/Translate@master] ttmserver-export: Add workaround for T258860

https://gerrit.wikimedia.org/r/793393

Change 793062 merged by jenkins-bot:

[translatewiki@master] Fixes for Elasticsearch upgrade

https://gerrit.wikimedia.org/r/793062

@abi_ can we consider this task done and close it so we can merge https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Translate/+/776221?

Yes it can be reviewed and merged now. I am keeping this task open until the associated patches for workarounds and fixes we did on the fly during the upgrade are reviewed and merged.

Change 793393 merged by jenkins-bot:

[mediawiki/extensions/Translate@master] ttmserver-export: Add workaround for T258860

https://gerrit.wikimedia.org/r/793393