Page MenuHomePhabricator

Migrate deployment-prep elasticsearch cluster to opensearch
Closed, ResolvedPublic

Description

The production search cluster is about to switch to OpenSearch.

We should migrate deployment-prep as well so that it remains close to what's running in production.

AC:

  • deployment-prep is running OpenSearch instead of Elasticsearch for the search cluster

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Change #1131098 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] cirrussearch: create a puppet plan for beta cluster

https://gerrit.wikimedia.org/r/1131098

Per IRC conversation, I've been requested to publicize these changes as follows:

We also need to update the mediawiki config labservices file to point to the new DP cirrussearch (nee elastic) hosts.

bking changed the task status from Open to In Progress.Mar 26 2025, 1:44 PM
bking claimed this task.

Change #1131098 merged by Bking:

[operations/puppet@production] cirrussearch: create a puppet plan for beta cluster

https://gerrit.wikimedia.org/r/1131098

Change #1131333 had a related patch set uploaded (by DCausse; author: DCausse):

[operations/mediawiki-config@master] cirrus: add extra opensearch cluster in the beta cluster

https://gerrit.wikimedia.org/r/1131333

Change #1131334 had a related patch set uploaded (by DCausse; author: DCausse):

[operations/mediawiki-config@master] cirrus: allow writing to eqiad-opensearch in deployment-prep

https://gerrit.wikimedia.org/r/1131334

Change #1131335 had a related patch set uploaded (by DCausse; author: DCausse):

[operations/mediawiki-config@master] cirrus: use only deployment-cirrussearch*.deployment-prep

https://gerrit.wikimedia.org/r/1131335

Change #1131340 had a related patch set uploaded (by Bking; author: Bking):

[operations/puppet@production] deployment-prep: set correct opensearch version for new cirrussearch servers

https://gerrit.wikimedia.org/r/1131340

Change #1131340 merged by Bking:

[operations/puppet@production] deployment-prep: set correct opensearch version for new cirrussearch servers

https://gerrit.wikimedia.org/r/1131340

Mentioned in SAL (#wikimedia-releng) [2025-03-26T17:10:16Z] <inflatador> bking@deployment-prep reverted an accident replacement of deployment-acme-chief.yaml T389971

Change #1131333 merged by jenkins-bot:

[operations/mediawiki-config@master] cirrus: use search-psi to point to opensearch cluster in the beta cluster

https://gerrit.wikimedia.org/r/1131333

Change #1131440 had a related patch set uploaded (by Ebernhardson; author: Ebernhardson):

[operations/mediawiki-config@master] beta cluster: Add eqiad-opensearch to cirrus writable clusters

https://gerrit.wikimedia.org/r/1131440

Change #1131440 merged by jenkins-bot:

[operations/mediawiki-config@master] beta cluster: Add eqiad-opensearch to cirrus writable clusters

https://gerrit.wikimedia.org/r/1131440

Change #1131334 abandoned by DCausse:

[operations/mediawiki-config@master] cirrus: allow writing to eqiad-opensearch in deployment-prep

Reason:

done in Ib922b73d6fbd7a6e1d36654df7173d41155283a5

https://gerrit.wikimedia.org/r/1131334

Change #1131335 merged by jenkins-bot:

[operations/mediawiki-config@master] cirrus: use only deployment-cirrussearch*.deployment-prep

https://gerrit.wikimedia.org/r/1131335

Mentioned in SAL (#wikimedia-releng) [2025-03-31T08:24:02Z] <dcausse> T389971: shutting down deployment-elastic* VMs in deployment-prep

Mentioned in SAL (#wikimedia-releng) [2025-03-31T11:08:10Z] <dcausse> T389971: deleting deployment-elastic* VMs in deployment-prep

EBernhardson subscribed.

I suspect this is complete and can be moved to done? The deployment-elastic* instances no longer exist, and https://en.wikipedia.beta.wmflabs.org/wiki/Special:Version shows it talking to opensearch as expected.

Change #1134151 had a related patch set uploaded (by DCausse; author: DCausse):

[operations/puppet@production] deployment-prep: cleanup deployment-elastic values

https://gerrit.wikimedia.org/r/1134151

Change #1134151 merged by Bking:

[operations/puppet@production] deployment-prep: cleanup deployment-elastic values

https://gerrit.wikimedia.org/r/1134151