We are getting alerts for curator_actions_apifeatureusage_codfw.service on apifeatureusage1001:9100 . That service is failing because its version of Curator does not work with OpenSearch:
May 18 00:42:03 apifeatureusage1001 curator[1911181]: 2025-05-18 00:42:03,203 ERROR Elasticsearch version 1.3.20 incompatible with this version of Curator (5.8.1)
We can probably do a quick fix by using the Observability-maintained curator fork that's in our apt repos . The long-term fix (using OpenSearch's built-in lifecycle management) is being discussed in T386525 .
Creating this ticket to:
- Write Puppet code to use an OpenSearch-compatible version of Curator and apply to apifeatureusage hosts.
- Confirm operation