Page MenuHomePhabricator

Remove elasticsearch-curator dependency from Spicerack/Elastic cookbooks
Open, MediumPublic

Description

Per parent ticket, the dependencies on Elastic curator are preventing Spicerack from building on Bookworm. Our options are:

  • Build our own Debian package for Curator
  • Remove the dependencies on Curator by using Elasticsearch client or REST API calls.

I've made some attempts at building a Curator package in T361105 , but at this point I think it would be easier to reimplement our Spicerack code using the elasticsearch client , especially considering we'll probably be on Opensearch within the next year or so.

Creating this ticket to re-implement the Spicerack code as Elasticsearch client calls.

Event Timeline

bking renamed this task from Remove elasticsearch-curator dependency from Elastic cookbooks to Remove elasticsearch-curator dependency from Spicerack/Elastic cookbooks.Tue, Apr 2, 9:18 PM
bking removed RKemper as the assignee of this task.

Change #1016855 had a related patch set uploaded (by Bking; author: Bking):

[operations/software/spicerack@master] WIP: remove elasticsearch-curator dependency

https://gerrit.wikimedia.org/r/1016855

Volans triaged this task as Medium priority.

De-assigning it from me as Brian is working on this.

bking updated Other Assignee, added: bking.

Assigning to @RKemper /adding DPE SRE tags.

Change #1016855 merged by jenkins-bot:

[operations/software/spicerack@master] elasticsearch: remove elasticsearch-curator dep

https://gerrit.wikimedia.org/r/1016855

Change #1019686 had a related patch set uploaded (by Volans; author: Volans):

[operations/software/spicerack@master] setup.py: remove dependency elasticsearch-curator

https://gerrit.wikimedia.org/r/1019686

Change #1019686 merged by jenkins-bot:

[operations/software/spicerack@master] setup.py: remove dependency elasticsearch-curator

https://gerrit.wikimedia.org/r/1019686

Mentioned in SAL (#wikimedia-operations) [2024-04-15T14:04:08Z] <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster relforge: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T14:04:15Z] <bking@cumin2002> END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster relforge: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T14:04:27Z] <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster relforge: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T14:09:57Z] <bking@cumin2002> END (ERROR) - Cookbook sre.elasticsearch.rolling-operation (exit_code=97) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster relforge: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T14:48:39Z] <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T15:11:49Z] <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.RESTART (1 nodes at a time) for ElasticSearch cluster cloudelastic: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T16:23:16Z] <bking@cumin2002> START - Cookbook sre.elasticsearch.rolling-operation Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: T361647 - bking@cumin2002

Mentioned in SAL (#wikimedia-operations) [2024-04-15T17:42:54Z] <bking@cumin2002> END (PASS) - Cookbook sre.elasticsearch.rolling-operation (exit_code=0) Operation.RESTART (3 nodes at a time) for ElasticSearch cluster search_codfw: T361647 - bking@cumin2002