We currently use very basic elasticsearch curator functionality such as deleting old indices.
As we move to opensearch we can obviate the need for curator by using the built-in Opensearch Index State Management, which lets us specify simple lifecycle rules for indices.
(See https://opensearch.org/docs/latest/im-plugin/ism/index/)
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T370147 [Epic] Migration of the Elasticsearch 7.10 search cluster to OpenSearch | |||
| Open | None | T386525 Replace curator with opensearch index state management |
Related topic:
We are getting alerts for curator_actions_apifeatureusage_codfw.service on apifeatureusage1001:9100 . That service is failing because its version of Curator does not work with OpenSearch:
May 18 00:42:03 apifeatureusage1001 curator[1911181]: 2025-05-18 00:42:03,203 ERROR Elasticsearch version 1.3.20 incompatible with this version of Curator (5.8.1)
We can probably do a quick fix by using the Observability-maintained curator fork that's in our apt repos . However, the long-term fix is in the ticket.
I'm moving this out of our current milestone because I don't think that we're likely to work on it in the next few weeks.
It feels like quite a reasonably sized challenge to migrate, so probably warrants some careful planning.