Page MenuHomePhabricator

Allow operator to repool a set of nodes in parallel
Open, MediumPublic

Description

In tasks such as T373095 we could repool via hacky scripts like this. It would be handy to have a way to repool a bunch of nodes in parallel.

Event Timeline

ABran-WMF triaged this task as Medium priority.Sep 4 2024, 4:08 PM
ABran-WMF moved this task from Triage to Blocked on the DBA board.

Change #1073796 had a related patch set uploaded (by Arnaudb; author: Arnaudb):

[operations/cookbooks@master] mariadb: cookbook to repool hosts in parallel

https://gerrit.wikimedia.org/r/1073796

ABran-WMF changed the task status from Open to In Progress.Sep 18 2024, 1:35 PM
ABran-WMF claimed this task.
ABran-WMF moved this task from Todo to Doing on the Data-Persistence-Automations board.
ABran-WMF changed the task status from In Progress to Stalled.Sep 18 2024, 2:52 PM

I'll wait for T362893 for the next steps. In the meantime there is a shell logic placeholder that fills the blank spaces

Change #1077101 had a related patch set uploaded (by Volans; author: Volans):

[operations/cookbooks@master] sre.mysql.pool: add two new cookbooks

https://gerrit.wikimedia.org/r/1077101

ABran-WMF renamed this task from create a cookbook to repool a set of nodes to Allow operator to repool a set of nodes in parallel.Oct 18 2024, 8:33 AM

Change #1073796 abandoned by Arnaudb:

[operations/cookbooks@master] mariadb: cookbook to repool hosts in parallel

Reason:

https://gitlab.wikimedia.org/repos/sre/ansible-data-persistence-operations/-/commit/5ad0ef3022ce5cde590eba62a3d971f3bd81bf70

https://gerrit.wikimedia.org/r/1073796

Change #1077101 merged by jenkins-bot:

[operations/cookbooks@master] sre.mysql.pool: add two new cookbooks

https://gerrit.wikimedia.org/r/1077101

Marostegui changed the task status from Stalled to Open.Nov 7 2024, 11:26 AM

This is a very good idea! I think as T362893 is marked as resolved, this is not stalled anymore. Please correct me if there's something still blocking this.

You're 100% right! this is not stalled anymore indeed, good catch :)