Page MenuHomePhabricator
Create Task
Maniphest T286206

Create Ganeti test cluster
Closed, ResolvedPublic
Actions

Description

We need a Ganeti test cluster to test invasive changes (such as OS updates) without production impact.

New hardware to be procured via https://phabricator.wikimedia.org/T284954, but with current lead times, two servers from the current codfw capex will be initially repurposed for this.

Details

SubjectRepoBranchLines +/-
ganeti: Fix up row configuration for ganeti test clusteroperations/software/spicerackmaster+1 -1
Update names of nodes in new test clusteroperations/puppetproduction+3 -2
Enable RAPI Netbox sync for new test clusteroperations/puppetproduction+3 -4
Also apply ganeti_test role to 2002/2003operations/puppetproduction+2 -7
Extend ganeti-all alias to also include ganeti_testoperations/puppetproduction+2 -1
Reset profile::ganeti::ganeti216 to false for the roleoperations/puppetproduction+1 -1
Switch ganeti-test2001 to ganeti_test roleoperations/puppetproduction+6 -1
cumin: temporary remove ganeti-test aliasoperations/puppetproduction+1 -2
netbox: remove sync from codfw ganeti clusteroperations/puppetproduction+4 -3
Add testvm2003operations/puppetproduction+1 -1
Add testvm200[12] to site.ppoperations/puppetproduction+6 -0
Add record for ganeti testclusteroperations/dnsmaster+1 -0
addnode cookbook: Also allow ganeti test cluster roleoperations/cookbooksmaster+1 -1
ganeti: Add ganeti test cluster to locationsoperations/software/spicerackmaster+1 -0
Update Cumin aliases for Ganeti test clusteroperations/puppetproduction+2 -1
Add ganeti2025/2026 to Ganeti test clusteroperations/puppetproduction+17 -1
Add ganeti_test to wikimedia_clustersoperations/puppetproduction+7 -0
Make the RAPI certname configurableoperations/puppetproduction+14 -3
Add cert for ganeti-test RAPIoperations/puppetproduction+23 -0
Add dummy certs for ganeti test clusterlabs/privatemaster+4 -0
Add separate role for Ganeti test clusteroperations/puppetproduction+22 -0
Show related patches Customize query in gerrit

Related Objects

Event Timeline

MoritzMuehlenhoff created this task.Jul 5 2021, 2:17 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJul 5 2021, 2:17 PM
gerritbot added a comment.Jul 5 2021, 2:22 PM

Change 703213 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add separate role for Ganeti test cluster

https://gerrit.wikimedia.org/r/703213

gerritbot added a project: Patch-For-Review.Jul 5 2021, 2:22 PM
gerritbot added a comment.Jul 6 2021, 6:45 AM

Change 703213 merged by Muehlenhoff:

[operations/puppet@production] Add separate role for Ganeti test cluster

https://gerrit.wikimedia.org/r/703213

Maintenance_bot removed a project: Patch-For-Review.Jul 6 2021, 7:10 AM
MoritzMuehlenhoff claimed this task.Jul 6 2021, 10:02 AM
gerritbot added a comment.Jul 21 2021, 2:09 PM

Change 705894 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[labs/private@master] Add dummy certs for ganeti test cluster

https://gerrit.wikimedia.org/r/705894

gerritbot added a project: Patch-For-Review.Jul 21 2021, 2:09 PM
gerritbot added a comment.Jul 21 2021, 2:19 PM

Change 705894 merged by Muehlenhoff:

[labs/private@master] Add dummy certs for ganeti test cluster

https://gerrit.wikimedia.org/r/705894

Muehlenhoff mentioned this in rLPRI8caab40d7a79: Add dummy certs for ganeti test cluster.Jul 21 2021, 2:19 PM
gerritbot added a comment.Jul 21 2021, 2:30 PM

Change 705899 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add cert for ganeti-test RAPI

https://gerrit.wikimedia.org/r/705899

gerritbot added a comment.Jul 21 2021, 2:36 PM

Change 705899 merged by Muehlenhoff:

[operations/puppet@production] Add cert for ganeti-test RAPI

https://gerrit.wikimedia.org/r/705899

Maintenance_bot removed a project: Patch-For-Review.Jul 21 2021, 3:10 PM
gerritbot added a comment.Jul 22 2021, 8:08 AM

Change 706315 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add ganeti2025/2026 to Ganeti test cluster

https://gerrit.wikimedia.org/r/706315

gerritbot added a project: Patch-For-Review.Jul 22 2021, 8:08 AM
gerritbot added a comment.Jul 22 2021, 12:19 PM

Change 706424 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Make the RAPI certname configurable

https://gerrit.wikimedia.org/r/706424

gerritbot added a comment.Jul 26 2021, 9:27 AM

Change 706424 merged by Muehlenhoff:

[operations/puppet@production] Make the RAPI certname configurable

https://gerrit.wikimedia.org/r/706424

gerritbot added a comment.Jul 28 2021, 10:28 AM

Change 708500 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add ganeti_test to wikimedia_clusters

https://gerrit.wikimedia.org/r/708500

gerritbot added a comment.Jul 28 2021, 11:42 AM

Change 708500 merged by Muehlenhoff:

[operations/puppet@production] Add ganeti_test to wikimedia_clusters

https://gerrit.wikimedia.org/r/708500

gerritbot added a comment.Jul 28 2021, 12:12 PM

Change 706315 merged by Muehlenhoff:

[operations/puppet@production] Add ganeti2025/2026 to Ganeti test cluster

https://gerrit.wikimedia.org/r/706315

gerritbot added a comment.Jul 29 2021, 1:17 PM

Change 708763 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/software/spicerack@master] ganeti: Add ganeti test cluster

https://gerrit.wikimedia.org/r/708763

gerritbot added a comment.Jul 30 2021, 7:54 AM

Change 708973 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Update Cumin aliases for Ganeti test cluster

https://gerrit.wikimedia.org/r/708973

gerritbot added a comment.Jul 30 2021, 7:56 AM

Change 708973 merged by Muehlenhoff:

[operations/puppet@production] Update Cumin aliases for Ganeti test cluster

https://gerrit.wikimedia.org/r/708973

gerritbot added a comment.Jul 30 2021, 8:02 AM

Change 708976 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/cookbooks@master] addnode cookbook: Also allow ganeti test cluster role

https://gerrit.wikimedia.org/r/708976

gerritbot added a comment.Aug 2 2021, 8:24 AM

Change 708763 merged by Muehlenhoff:

[operations/software/spicerack@master] ganeti: Add ganeti test cluster to locations

https://gerrit.wikimedia.org/r/708763

gerritbot added a comment.Aug 2 2021, 8:51 AM

Change 708976 merged by Muehlenhoff:

[operations/cookbooks@master] addnode cookbook: Also allow ganeti test cluster role

https://gerrit.wikimedia.org/r/708976

gerritbot added a comment.Aug 2 2021, 9:45 AM

Change 709386 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/dns@master] Add record for ganeti testcluster

https://gerrit.wikimedia.org/r/709386

gerritbot added a comment.Aug 2 2021, 10:17 AM

Change 709386 merged by Muehlenhoff:

[operations/dns@master] Add record for ganeti testcluster

https://gerrit.wikimedia.org/r/709386

Stashbot added a comment.Aug 3 2021, 11:13 AM

Mentioned in SAL (#wikimedia-operations) [2021-08-03T11:13:02Z] <moritzm> rename Ganeti group for test cluster to row_D T286206

ops-monitoring-bot added a comment.Aug 3 2021, 2:56 PM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2001.codfw.wmnet

  • testvm2001.codfw.wmnet (FAIL)
    • Host steps raised exception: Host testvm2001 was not found in Icinga status - no hosts have been downtimed.

ERROR: some step on some host failed, check the bolded items above

Stashbot added a comment.Aug 3 2021, 3:25 PM

Mentioned in SAL (#wikimedia-operations) [2021-08-03T15:25:05Z] <moritzm> prune testvm2001 from Ganeti and clean up from Netbox (stuck in some inconsistent state the decom cookbook can't handle) T286206

Stashbot added a comment.Aug 4 2021, 6:53 AM

Mentioned in SAL (#wikimedia-operations) [2021-08-04T06:53:30Z] <moritzm> installing testvm2002 T286206

Stashbot added a comment.Aug 4 2021, 11:43 AM

Mentioned in SAL (#wikimedia-operations) [2021-08-04T11:43:29Z] <moritzm> installing testvm2001 T286206

gerritbot added a comment.Aug 4 2021, 12:16 PM

Change 710017 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add testvm200[12] to site.pp

https://gerrit.wikimedia.org/r/710017

gerritbot added a comment.Aug 4 2021, 12:39 PM

Change 710017 merged by Muehlenhoff:

[operations/puppet@production] Add testvm200[12] to site.pp

https://gerrit.wikimedia.org/r/710017

MoritzMuehlenhoff added a comment.Aug 4 2021, 3:55 PM

The Ganeti test cluster has been set up, along with two test instances (testvm2001/2002). Next it will be used to test the Buster update.

ops-monitoring-bot added a comment.Sep 13 2021, 10:51 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2002.codfw.wmnet

  • testvm2002.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
ops-monitoring-bot added a comment.Sep 21 2021, 10:54 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2001.codfw.wmnet

  • testvm2001.codfw.wmnet (WARN)
    • Host not found on Icinga, unable to downtme it
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
• ayounsi moved this task from Backlog to In Progress on the Infrastructure-Foundations board.Sep 21 2021, 1:11 PM
joanna_borun changed the task status from Open to In Progress.Sep 21 2021, 1:32 PM
ops-monitoring-bot added a comment.Sep 28 2021, 11:08 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2002.codfw.wmnet

  • testvm2002.codfw.wmnet (WARN)
    • Host not found on Icinga, unable to downtime it
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
gerritbot added a comment.Sep 29 2021, 2:17 PM

Change 724753 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Add testvm2003

https://gerrit.wikimedia.org/r/724753

gerritbot added a comment.Sep 29 2021, 2:19 PM

Change 724753 merged by Muehlenhoff:

[operations/puppet@production] Add testvm2003

https://gerrit.wikimedia.org/r/724753

ops-monitoring-bot added a comment.Sep 29 2021, 2:25 PM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2001.codfw.wmnet

  • testvm2001.codfw.wmnet (WARN)
    • Host not found on Icinga, unable to downtime it
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
  • COMMON_STEPS (FAIL)
    • Failed to run the sre.dns.netbox cookbook: Cumin execution failed (exit_code=2)

ERROR: some step on some host failed, check the bolded items above

ops-monitoring-bot added a comment.Oct 6 2021, 11:56 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2003.codfw.wmnet

  • testvm2003.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
  • COMMON_STEPS (FAIL)
    • Failed to run the sre.dns.netbox cookbook: Cumin execution failed (exit_code=2)

ERROR: some step on some host failed, check the bolded items above

ops-monitoring-bot added a comment.Oct 7 2021, 9:27 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2004.codfw.wmnet

  • testvm2004.codfw.wmnet (WARN)
    • Host not found on Icinga, unable to downtime it
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
  • COMMON_STEPS (FAIL)
    • Failed to run the sre.dns.netbox cookbook: Cumin execution failed (exit_code=2)

ERROR: some step on some host failed, check the bolded items above

ops-monitoring-bot added a comment.Oct 14 2021, 10:38 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2001.codfw.wmnet

  • testvm2001.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
ops-monitoring-bot added a comment.Oct 14 2021, 10:52 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2002.codfw.wmnet

  • testvm2002.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
ops-monitoring-bot added a comment.Oct 14 2021, 11:16 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2006.codfw.wmnet

  • testvm2006.codfw.wmnet (WARN)
    • Host not found on Icinga, unable to downtime it
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
ops-monitoring-bot added a comment.Oct 14 2021, 11:47 AM

Cookbook cookbooks.sre.hosts.reimage was started by jmm@cumin2002 for host ganeti2026.codfw.wmnet with OS buster

ops-monitoring-bot added a comment.Oct 14 2021, 12:45 PM

Cookbook cookbooks.sre.hosts.reimage started by jmm@cumin2002 for host ganeti2026.codfw.wmnet with OS buster completed:

  • ganeti2026 (PASS)
    • Downtimed on Icinga
    • Disabled Puppet
    • Removed from Puppet and PuppetDB if present
    • Deleted any existing Puppet certificate
    • Removed from Debmonitor if present
    • Forced PXE for next reboot
    • Host rebooted via IPMI
    • Host up (Debian installer)
    • Host up (new fresh buster OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • Found Nagios_host resource for this host in PuppetDB
    • Downtimed the new host on Icinga
    • First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202110141146_jmm_3011474_ganeti2026.out
    • Checked BIOS boot parameters are back to normal
    • Rebooted
    • Automatic Puppet run was successful
    • Forced a re-check of all Icinga services for the host
    • Icinga status is optimal
    • Icinga downtime removed
    • Updated Netbox data from PuppetDB
ops-monitoring-bot added a comment.Oct 20 2021, 11:32 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2005.codfw.wmnet

  • testvm2005.codfw.wmnet (PASS)
    • Downtimed host on Icinga
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
ops-monitoring-bot added a comment.Oct 20 2021, 11:46 AM

cookbooks.sre.hosts.decommission executed by jmm@cumin2002 for hosts: testvm2007.codfw.wmnet

  • testvm2007.codfw.wmnet (WARN)
    • Host not found on Icinga, unable to downtime it
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti-test01.svc.codfw.wmnet to Netbox
gerritbot added a comment.Oct 25 2021, 8:08 AM

Change 734204 had a related patch set uploaded (by Volans; author: Volans):

[operations/puppet@production] netbox: remove sync from codfw ganeti cluster

https://gerrit.wikimedia.org/r/734204

gerritbot added a comment.Oct 25 2021, 8:11 AM

Change 734204 merged by Volans:

[operations/puppet@production] netbox: remove sync from codfw ganeti cluster

https://gerrit.wikimedia.org/r/734204

gerritbot added a comment.Oct 25 2021, 8:46 AM

Change 734206 had a related patch set uploaded (by Volans; author: Volans):

[operations/puppet@production] cumin: temporary remove ganeti-test alias

https://gerrit.wikimedia.org/r/734206

gerritbot added a comment.Oct 25 2021, 8:48 AM

Change 734206 merged by Volans:

[operations/puppet@production] cumin: temporary remove ganeti-test alias

https://gerrit.wikimedia.org/r/734206

gerritbot added a comment.Nov 3 2021, 11:31 AM

Change 736447 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Switch ganeti-test2001 to ganeti_test role

https://gerrit.wikimedia.org/r/736447

gerritbot added a comment.Nov 3 2021, 11:36 AM

Change 736447 merged by Muehlenhoff:

[operations/puppet@production] Switch ganeti-test2001 to ganeti_test role

https://gerrit.wikimedia.org/r/736447

gerritbot added a comment.Nov 3 2021, 11:49 AM

Change 736449 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Reset profile::ganeti::ganeti216 to false for the role

https://gerrit.wikimedia.org/r/736449

gerritbot added a comment.Nov 3 2021, 11:50 AM

Change 736449 merged by Muehlenhoff:

[operations/puppet@production] Reset profile::ganeti::ganeti216 to false for the role

https://gerrit.wikimedia.org/r/736449

Stashbot added a comment.Nov 3 2021, 2:10 PM

Mentioned in SAL (#wikimedia-operations) [2021-11-03T14:10:37Z] <moritzm> initialising ganeti-test01.svc.codfw.wmnet cluster on ganeti-test2001 T286206

gerritbot added a comment.Nov 3 2021, 4:32 PM

Change 736529 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Extend ganeti-all alias to also include ganeti_test

https://gerrit.wikimedia.org/r/736529

gerritbot added a comment.Nov 3 2021, 4:38 PM

Change 736529 merged by Muehlenhoff:

[operations/puppet@production] Extend ganeti-all alias to also include ganeti_test

https://gerrit.wikimedia.org/r/736529

gerritbot added a comment.Nov 4 2021, 9:43 AM

Change 736707 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Also apply ganeti_test role to 2002/2003

https://gerrit.wikimedia.org/r/736707

gerritbot added a comment.Nov 4 2021, 10:04 AM

Change 736707 merged by Muehlenhoff:

[operations/puppet@production] Also apply ganeti_test role to 2002/2003

https://gerrit.wikimedia.org/r/736707

gerritbot added a comment.Nov 4 2021, 10:59 AM

Change 736724 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Enable RAPI Netbox sync for new test cluster

https://gerrit.wikimedia.org/r/736724

gerritbot added a comment.Nov 4 2021, 11:35 AM

Change 736724 merged by Muehlenhoff:

[operations/puppet@production] Enable RAPI Netbox sync for new test cluster

https://gerrit.wikimedia.org/r/736724

gerritbot added a comment.Nov 4 2021, 12:47 PM

Change 736759 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/puppet@production] Update names of nodes in new test cluster

https://gerrit.wikimedia.org/r/736759

gerritbot added a comment.Nov 4 2021, 12:50 PM

Change 736759 merged by Muehlenhoff:

[operations/puppet@production] Update names of nodes in new test cluster

https://gerrit.wikimedia.org/r/736759

Stashbot added a comment.Nov 5 2021, 8:52 AM

Mentioned in SAL (#wikimedia-operations) [2021-11-05T08:52:49Z] <moritzm> installing set kvm::machine_version for ganeti-test cluster to pc-i440fx-2.8 T286206

gerritbot added a comment.Nov 5 2021, 9:36 AM

Change 736994 had a related patch set uploaded (by Muehlenhoff; author: Muehlenhoff):

[operations/software/spicerack@master] ganeti: Fix up row configuration for ganeti test cluster

https://gerrit.wikimedia.org/r/736994

gerritbot added a comment.Nov 5 2021, 10:40 AM

Change 736994 merged by Muehlenhoff:

[operations/software/spicerack@master] ganeti: Fix up row configuration for ganeti test cluster

https://gerrit.wikimedia.org/r/736994

Stashbot added a comment.Nov 5 2021, 12:22 PM

Mentioned in SAL (#wikimedia-operations) [2021-11-05T12:22:58Z] <moritzm> renamed Ganeti group of test cluster from "default" to "row_A" (following conventions in main DCs) T286206

MoritzMuehlenhoff closed this task as Resolved.Nov 16 2021, 12:25 PM

The new Ganeti test cluster has been setup: It consists of three nodes in row A of codfw (ganeti-test200[1-3].codfw.wmnet). A test instance has been added with the makevm cookbook and instance migration and master failover are also working fine.

Muehlenhoff mentioned this in rCCKBe44cd27982aa: addnode cookbook: Also allow ganeti test cluster role.Dec 14 2022, 3:28 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits