Page MenuHomePhabricator

๐ŸŸช Update ElasticSearch to 7.10.2
Closed, ResolvedPublic

Description

Given that CirrusSearch docs recommends MediaWiki 1.39+ uses this version we probably want to upgrade to this once we have completed T327646

We will probably want to upgrade by running parallel clusters of ES 6 and 7.

Fully populating the 7 cluster and having updates to it written in parallel before moving read traffic over and then decommissioning the 6.x cluster.

Steps:

  1. deploy a new version of ElasticSearch 7. e.g. build new image, make sure to include the wmf specific plugins etc. (this might be Already built by Adam for suite). This may also involve asking for more compute resources and temporarily spending more money
  2. configure mediawiki to continue reading from ES6 using the compatibility layer but also start writing to ES7 on edits
  3. schedule long running tasks (k8s jobs?) to fully reindex ES7.
  4. One complete configure mediawiki to read from ES7 but continue writing to ES6 (if we then discover issues with ES7 we can revert this config change to restore search for users)
  5. after being confident that it is working; decomisison ES6.

N.B. For documentation on how to correctly configure mediawiki to read and write from the right clusters at the right time see: https://gerrit.wikimedia.org/g/mediawiki/extensions/CirrusSearch/%2B/HEAD/docs/settings.txt

Event Timeline

Restricted Application added a subscriber: Aklapper. ยท View Herald TranscriptMar 2 2023, 11:31 AM
Deniz_WMDE renamed this task from Update ElasticSearch to 7.10.2 to ๐ŸŸง Update ElasticSearch to 7.10.2.Aug 21 2023, 9:09 AM
Deniz_WMDE renamed this task from ๐ŸŸง Update ElasticSearch to 7.10.2 to ๐ŸŸช Update ElasticSearch to 7.10.2.Aug 21 2023, 9:19 AM