Page MenuHomePhabricator
Create Task
Maniphest T401818

Upgrade Toolforge (Elastic|Open)Search cluster off of Bullseye
Open, MediumPublic
Actions

Description

Previous work: T311905: Upgrade Toolforge (Elastic|Open)Search cluster to Debian Bullseye

Related: T348943: Deploy multi-tenant OpenSearch cluster as replacement for Elasticsearch

Details

Related Changes in Gerrit:
SubjectAuthorRepoBranchLines +/-
P:toolforge::prometheus: Remove Elasticsearch targetsMajavahoperations/puppetproduction+0 -10
O:wmcs::toolforge: Remove Elasticsearch related classesMajavahoperations/puppetproduction+0 -142
P:toolforge::bastion: Remove temporary index migration scriptMajavahoperations/puppetproduction+1 -142
P:toolforge::elasticsearch: Disable access to old clusterMajavahoperations/puppetproduction+0 -8
P:toolforge::bastion: Add script to migrate OpenSearch indexesMajavahoperations/puppetproduction+141 -0
P:toolforge::prometheus: Add opensearch metricsMajavahoperations/puppetproduction+10 -0
P:toolforge::opensearch: Add HAProxy for client accessMajavahoperations/puppetproduction+105 -0
P:toolforge::opensearch: Add KeepalivedMajavahoperations/puppetproduction+20 -0
O:wmcs::toolforge::opensearch: Add new roleMajavahoperations/puppetproduction+7 -0
Customize query in gerrit
Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
Rebrand Elasticsearch alerts as OpenSearch alertsrepos/cloud/toolforge/alerts!71taavimain-I655ca1eaaba8f2fa471ed001e19b0c668171866emain
envvars-admission: Drop old ElasticSearch-related variablesrepos/cloud/toolforge/toolforge-deploy!1394taavimain-Ia9ffabab3f1d54dd500b5fbd46c77a7d4fcfdd10main
envvars-admission: Update open/elasticsearch related varsrepos/cloud/toolforge/toolforge-deploy!1351taavimain-I90d606b158eef0875e0be7fbb14a66ee2904bf03main
Customize query in GitLab

Related Objects
Search...

Event Timeline

• taavi created this task.Aug 13 2025, 11:16 AM
• bd808 updated the task description. (Show Details)Aug 13 2025, 3:11 PM
• taavi triaged this task as Medium priority.Aug 15 2025, 1:19 PM
• taavi claimed this task.Jul 20 2026, 11:51 AM
Restricted Application added a project: tools-platform-team. · View Herald TranscriptJul 20 2026, 11:51 AM
CodeReviewBot added a project: Patch-For-Review.Jul 20 2026, 11:55 AM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/121

tools: Provision Opensearch VMs

CodeReviewBot added a comment.Jul 20 2026, 11:55 AM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/120

tools: Add scaffolding for new OpenSearch service

CodeReviewBot added a comment.Jul 20 2026, 11:55 AM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/123

tools: Add Opensearch svc DNS entries

CodeReviewBot added a comment.Jul 20 2026, 12:07 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/120

tools: Add scaffolding for new OpenSearch service

CodeReviewBot added a comment.Jul 20 2026, 12:13 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/124

tools: Add volumes to Opensearch VMs

CodeReviewBot added a comment.Jul 20 2026, 12:14 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/121

tools: Provision Opensearch VMs

gerritbot added a comment.Jul 20 2026, 12:54 PM

Change #1312494 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] O:wmcs::toolforge::opensearch: Add new role

https://gerrit.wikimedia.org/r/1312494

aputhin edited projects, added: tools-infrastructure-team; removed: tools-platform-team, cloud-services-team.Jul 20 2026, 1:07 PM
gerritbot added a comment.Jul 20 2026, 1:08 PM

Change #1312494 merged by Majavah:

[operations/puppet@production] O:wmcs::toolforge::opensearch: Add new role

https://gerrit.wikimedia.org/r/1312494

CodeReviewBot added a comment.Jul 22 2026, 3:43 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/123

tools: Add Opensearch svc DNS entries

CodeReviewBot added a comment.Jul 22 2026, 3:45 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/124

tools: Add volumes to Opensearch VMs

Maintenance_bot removed a project: Patch-For-Review.Jul 22 2026, 4:32 PM
gerritbot added a comment.Jul 22 2026, 5:13 PM

Change #1314057 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::opensearch: Add Keepalived

https://gerrit.wikimedia.org/r/1314057

gerritbot added a project: Patch-For-Review.Jul 22 2026, 5:13 PM
gerritbot added a comment.Jul 22 2026, 5:20 PM

Change #1314057 merged by Majavah:

[operations/puppet@production] P:toolforge::opensearch: Add Keepalived

https://gerrit.wikimedia.org/r/1314057

Maintenance_bot removed a project: Patch-For-Review.Jul 22 2026, 5:31 PM
gerritbot added a comment.Jul 27 2026, 1:18 PM

Change #1318136 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::opensearch: Add HAProxy for client access

https://gerrit.wikimedia.org/r/1318136

gerritbot added a project: Patch-For-Review.Jul 27 2026, 1:18 PM
gerritbot added a comment.Jul 27 2026, 1:21 PM

Change #1318141 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::prometheus: Add opensearch metrics

https://gerrit.wikimedia.org/r/1318141

gerritbot added a comment.Jul 27 2026, 1:36 PM

Change #1318136 merged by Majavah:

[operations/puppet@production] P:toolforge::opensearch: Add HAProxy for client access

https://gerrit.wikimedia.org/r/1318136

gerritbot added a comment.Jul 27 2026, 1:50 PM

Change #1318141 merged by Majavah:

[operations/puppet@production] P:toolforge::prometheus: Add opensearch metrics

https://gerrit.wikimedia.org/r/1318141

Maintenance_bot removed a project: Patch-For-Review.Jul 27 2026, 2:31 PM
gerritbot added a comment.Jul 27 2026, 6:07 PM

Change #1318228 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::bastion: Add script to migrate OpenSearch indexes

https://gerrit.wikimedia.org/r/1318228

gerritbot added a project: Patch-For-Review.Jul 27 2026, 6:07 PM
gerritbot added a comment.Jul 29 2026, 3:41 PM

Change #1318228 merged by Majavah:

[operations/puppet@production] P:toolforge::bastion: Add script to migrate OpenSearch indexes

https://gerrit.wikimedia.org/r/1318228

CodeReviewBot added a comment.Jul 29 2026, 4:27 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1351

envvars-admission: Update open/elasticsearch related vars

CodeReviewBot added a comment.Jul 30 2026, 11:31 AM

dcaro merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1351

envvars-admission: Update open/elasticsearch related vars

Maintenance_bot removed a project: Patch-For-Review.Jul 30 2026, 12:32 PM
Krinkle awarded a token.Jul 30 2026, 3:00 PM
• bd808 mentioned this in T435223: Migrate storage to new OpenSearch v2 Toolforge cluster.Aug 18 2026, 3:56 PM
Izno subscribed.Aug 19 2026, 5:56 PM
gerritbot added a comment.Aug 24 2026, 9:32 AM

Change #1328539 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::elasticsearch: Disable access to old cluster

https://gerrit.wikimedia.org/r/1328539

gerritbot added a project: Patch-For-Review.Aug 24 2026, 9:32 AM
Stashbot added a comment.Aug 24 2026, 10:46 AM

Mentioned in SAL (#wikimedia-cloud) [2026-08-24T10:46:06Z] <taavi> disable access to elastic cluster as announced on cloud-announce T401818

gerritbot added a comment.Aug 24 2026, 10:46 AM

Change #1328539 merged by Majavah:

[operations/puppet@production] P:toolforge::elasticsearch: Disable access to old cluster

https://gerrit.wikimedia.org/r/1328539

Maintenance_bot removed a project: Patch-For-Review.Aug 24 2026, 11:31 AM
Stashbot added a comment.Aug 25 2026, 6:14 PM

Mentioned in SAL (#wikimedia-cloud) [2026-08-25T18:14:43Z] <wmbot~bd808@tools-bastion-14> Update to 24fb23a6 (T401818)

• bd808 mentioned this in R1958:24fb23a67d58: Fetch SAL from new OpenSearch cluster.Aug 26 2026, 12:02 AM
CodeReviewBot added a project: Patch-For-Review.Aug 31 2026, 4:31 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1394

envvars-admission: Drop old ElasticSearch-related variables

gerritbot added a comment.Aug 31 2026, 5:33 PM

Change #1332769 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::bastion: Remove temporary index migration script

https://gerrit.wikimedia.org/r/1332769

gerritbot added a comment.Aug 31 2026, 5:33 PM

Change #1332770 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] O:wmcs::toolforge: Remove Elasticsearch related classes

https://gerrit.wikimedia.org/r/1332770

Stashbot added a comment.Aug 31 2026, 6:03 PM

Mentioned in SAL (#wikimedia-cloud) [2026-08-31T18:03:14Z] <taavi> shut down old elasticsearch v7 infrastructure T401818

gerritbot added a comment.Aug 31 2026, 6:04 PM

Change #1332777 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] P:toolforge::prometheus: Remove Elasticsearch targets

https://gerrit.wikimedia.org/r/1332777

CodeReviewBot added a comment.Aug 31 2026, 6:09 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/71

Rebrand Elasticsearch alerts as OpenSearch alerts

gerritbot added a comment.Sep 1 2026, 7:23 AM

Change #1332769 merged by Majavah:

[operations/puppet@production] P:toolforge::bastion: Remove temporary index migration script

https://gerrit.wikimedia.org/r/1332769

gerritbot added a comment.Sep 1 2026, 7:24 AM

Change #1332770 merged by Majavah:

[operations/puppet@production] O:wmcs::toolforge: Remove Elasticsearch related classes

https://gerrit.wikimedia.org/r/1332770

gerritbot added a comment.Sep 1 2026, 7:34 AM

Change #1332777 merged by Majavah:

[operations/puppet@production] P:toolforge::prometheus: Remove Elasticsearch targets

https://gerrit.wikimedia.org/r/1332777

CodeReviewBot added a comment.Sep 1 2026, 1:45 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/71

Rebrand Elasticsearch alerts as OpenSearch alerts

CodeReviewBot added a comment.Sep 2 2026, 11:24 AM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/125

tools: Remove Elasticsearch DNS record

CodeReviewBot added a comment.Sep 2 2026, 11:24 AM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/126

tools: Remove Elasticsearch volumes

CodeReviewBot added a comment.Sep 3 2026, 8:35 AM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/tofu-provisioning/-/merge_requests/125

tools: Remove Elasticsearch DNS record

CodeReviewBot added a comment.Thu, Sep 10, 3:57 PM

dcaro merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/1394

envvars-admission: Drop old ElasticSearch-related variables

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits