Page MenuHomePhabricator

Toolforge grid deployment/management automation
Closed, ResolvedPublic

Description

This task is to track work to automate several tasks related to grid deployment and maintenance (mostly by means of spicerack/cookbooks).

  • run grid-configurator (cookbook wmcs.toolforge.grid.reconfigure)
  • create instance (cookbook wmcs.toolforge.grid.add_node_to_cluster)
  • handle all grid exec node types
  • bastion deployment ??
  • operations in batches

Event Timeline

aborrero triaged this task as Medium priority.Jan 11 2022, 9:34 AM
aborrero created this task.
aborrero moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.

Change 753006 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: add cookbook to create an exec node

https://gerrit.wikimedia.org/r/753006

Change 753017 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: factorized node creation cookbook

https://gerrit.wikimedia.org/r/753017

Change 753018 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: relocate start_instance_with_prefix cookbook

https://gerrit.wikimedia.org/r/753018

Change 753027 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: relocate some node-specific cookbooks

https://gerrit.wikimedia.org/r/753027

Change 753017 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: grid: factorized node creation cookbook

https://gerrit.wikimedia.org/r/753017

Change 753006 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: add cookbooks to scale the grid with each node type

https://gerrit.wikimedia.org/r/753006

Change 753027 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: relocate some node-specific cookbooks

https://gerrit.wikimedia.org/r/753027

Change 753018 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: relocate start_instance_with_prefix cookbook

https://gerrit.wikimedia.org/r/753018

Change 754555 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: introduce cookbook to repool a node

https://gerrit.wikimedia.org/r/754555

Change 754944 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: introduce cookbook to verify basic grid health

https://gerrit.wikimedia.org/r/754944

Change 755321 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/puppet@production] toolforge: deploy test suite

https://gerrit.wikimedia.org/r/755321

Change 755321 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] toolforge: deploy test suite

https://gerrit.wikimedia.org/r/755321

Change 754555 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: grid: introduce cookbook to repool a node

https://gerrit.wikimedia.org/r/754555

Change 754944 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: introduce cookbook to run tests

https://gerrit.wikimedia.org/r/754944

aborrero renamed this task from Toolforge grid deployment automation to Toolforge grid deployment/management automation.Jan 27 2022, 1:20 PM
aborrero updated the task description. (Show Details)

Change 761440 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: pool: introduce support for nodeset-syntax host selection

https://gerrit.wikimedia.org/r/761440

Change 761440 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: grid: pool: introduce support for nodeset-syntax host selection

https://gerrit.wikimedia.org/r/761440

Change 761618 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/cookbooks@wmcs] wmcs: toolforge: grid: node: join: add support for nodeset query syntax

https://gerrit.wikimedia.org/r/761618

Change 761618 merged by Arturo Borrero Gonzalez:

[operations/cookbooks@wmcs] wmcs: toolforge: grid: node: join: add support for nodeset query syntax

https://gerrit.wikimedia.org/r/761618

The most common operations are now automated.

This patch https://gerrit.wikimedia.org/r/761618 includes a way to use nodeset query syntax for batch operations. We could refactor that code if we want to introduce it into other cookbooks.

I decided that automation for bastion provisioning is not worth the effort as of today.