Per this Puppet code, Elasticsearch curator should be purging apifatureusage indices every 91 days.
However, a recent audit reveals we have apifeatureusage indices dating back ~2 years . Creating this ticket to:
Glancing at ryankemper@apifeatureusage1001:~$ sudo journalctl -u curator_actions_apifeatureusage_eqiad:
Mar 19 00:42:07 apifeatureusage1001 curator[4112912]: 2024-03-19 00:42:07,974 ERROR Elasticsearch version 7.10.2 incompatible with this version of Curator (5.6.0)
This is likely the ultimate source of the problem.
We'll start testing the newest 7.x version of curator; once we're sure it works, we can deploy to production.