Change Details

Tracking task of the agreed work between the #cloud-services team and the #infrastructure-foundations one for a better integration with WMCS of the cookbook automation. I've grouped the work based on affected areas. We can open subtask as needed. #### ✅ Improve the laptop local environment T319426 Add ssh socks5 proxy support (blocks removing duplication) (1 day) #### ✅ New WMCS cookbooks repository [x] Create new repo or reuse wmcs-cookbooks (done! https://gerrit.wikimedia.org/r/admin/repos/cloud%2Fwmcs-cookbooks) (0 days :} ) T319436 Import into the new repo the code, splitting libs from cookbooks (½ day) #### ✅ Setup the production infrastructure T323516, T323518 Create cloud cumin ganeti hosts, 2 VMs, one per DC (½ day) [x] Setup dedicated SSH config for the double jump in cloud (½ day) ([patch](https://gerrit.wikimedia.org/r/c/operations/puppet/+/867551)) #### ✅ Spicerack improvements [X] Add module injection support (2 days) ([patch](https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/863004)) [X] Add register of accessors support (2 days) ([patch](https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/863004)) [x] ~~Add sudo everywhere (1w, might be less)~~ [not needed for the current setup] T325168 Load cookbooks from multiple directories (2 days) #### Setup the Cloud infrastructure T323483 Define which SSH key to use to SSH from the new cloud-cumin to hosts T323484 Fine tune the SSHd config of the restricted bastion for better performances (½ day) #### Misc T325756 Allow wmcs cookbooks running on cloudcuminXXXX to write to the SAL (1~2w) T325754 Update Spicerack documentation #### Postponed to later We could not complete the following tasks in Q2, and they can be postponed as they are not a blocker for the main goal of running WMCS cookbooks from the new cloudcumin hosts. T319438 Remove code duplication (alertmanager) (1w) T319450 Move the libs to spicerack modules (2w this might be really easy though, depending on the module solution) T325067 Decide sudoers rules for users without global root T325758 Spicerack: Add CI step to test with wmcs cookbooks (1w) T322511 [spicerack][alertmanager] support silencing alerts without instance label

WMCS cookbooks are currently run by the WMCS team from their own laptops. We would like to run them from a Cumin server in a similar way to production cookbooks. This is a tracking task of the agreed work between the #cloud-services team and the #infrastructure-foundations one. I've grouped the work based on affected areas. We can open subtask as needed. #### ✅ Improve the laptop local environment T319426 Add ssh socks5 proxy support (blocks removing duplication) (1 day) #### ✅ New WMCS cookbooks repository [x] Create new repo or reuse wmcs-cookbooks (done! https://gerrit.wikimedia.org/r/admin/repos/cloud%2Fwmcs-cookbooks) (0 days :} ) T319436 Import into the new repo the code, splitting libs from cookbooks (½ day) #### ✅ Setup the production infrastructure T323516, T323518 Create cloud cumin ganeti hosts, 2 VMs, one per DC (½ day) [x] Setup dedicated SSH config for the double jump in cloud (½ day) ([patch](https://gerrit.wikimedia.org/r/c/operations/puppet/+/867551)) #### ✅ Spicerack improvements [X] Add module injection support (2 days) ([patch](https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/863004)) [X] Add register of accessors support (2 days) ([patch](https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/863004)) [x] ~~Add sudo everywhere (1w, might be less)~~ [not needed for the current setup] T325168 Load cookbooks from multiple directories (2 days) #### ✅ Setup the Cloud infrastructure T323483 Define which SSH key to use to SSH from the new cloud-cumin to hosts T323484 Fine tune the SSHd config of the restricted bastion for better performances (½ day) #### Misc T325756 Allow wmcs cookbooks running on cloudcuminXXXX to write to the SAL (1~2w) T325754 Update Spicerack documentation #### Postponed to later We could not complete the following tasks in Q2, and they can be postponed as they are not a blocker for the main goal of running WMCS cookbooks from the new cloudcumin hosts. T319438 Remove code duplication (alertmanager) (1w) T319450 Move the libs to spicerack modules (2w this might be really easy though, depending on the module solution) T325067 Decide sudoers rules for users without global root T325758 Spicerack: Add CI step to test with wmcs cookbooks (1w) T322511 [spicerack][alertmanager] support silencing alerts without instance label

Tracking task of the agreed work between the #cloud-services team and the #infrastructure-foundations one for a better integration with WMCS of the cookbook automation.WMCS cookbooks are currently run by the WMCS team from their own laptops. We would like to run them from a Cumin server in a similar way to production cookbooks. This is a tracking task of the agreed work between the #cloud-services team and the #infrastructure-foundations one. I've grouped the work based on affected areas. We can open subtask as needed. #### ✅ Improve the laptop local environment T319426 Add ssh socks5 proxy support (blocks removing duplication) (1 day) #### ✅ New WMCS cookbooks repository [x] Create new repo or reuse wmcs-cookbooks (done! https://gerrit.wikimedia.org/r/admin/repos/cloud%2Fwmcs-cookbooks) (0 days :} ) T319436 Import into the new repo the code, splitting libs from cookbooks (½ day) #### ✅ Setup the production infrastructure T323516, T323518 Create cloud cumin ganeti hosts, 2 VMs, one per DC (½ day) [x] Setup dedicated SSH config for the double jump in cloud (½ day) ([patch](https://gerrit.wikimedia.org/r/c/operations/puppet/+/867551)) #### ✅ Spicerack improvements [X] Add module injection support (2 days) ([patch](https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/863004)) [X] Add register of accessors support (2 days) ([patch](https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/863004)) [x] ~~Add sudo everywhere (1w, might be less)~~ [not needed for the current setup] T325168 Load cookbooks from multiple directories (2 days) #### ✅ Setup the Cloud infrastructure T323483 Define which SSH key to use to SSH from the new cloud-cumin to hosts T323484 Fine tune the SSHd config of the restricted bastion for better performances (½ day) #### Misc T325756 Allow wmcs cookbooks running on cloudcuminXXXX to write to the SAL (1~2w) T325754 Update Spicerack documentation #### Postponed to later We could not complete the following tasks in Q2, and they can be postponed as they are not a blocker for the main goal of running WMCS cookbooks from the new cloudcumin hosts. T319438 Remove code duplication (alertmanager) (1w) T319450 Move the libs to spicerack modules (2w this might be really easy though, depending on the module solution) T325067 Decide sudoers rules for users without global root T325758 Spicerack: Add CI step to test with wmcs cookbooks (1w) T322511 [spicerack][alertmanager] support silencing alerts without instance label