Page MenuHomePhabricator

Please create two Ganeti VMs for Wikidough in esams
Closed, ResolvedPublic

Description

Please create two Ganeti VMs for Wikidough, with the following identical parameters in esams.

Specifications:

Hostname: doh3001, doh3002 (esams)
vCPUs: 2
Memory: 8
Disk: 10G
Network: Public

Event Timeline

ssingh triaged this task as Medium priority.May 27 2021, 6:28 PM

Change 696605 had a related patch set uploaded (by Ssingh; author: Ssingh):

[operations/puppet@production] site: add doh3001 and doh3002 with role insetup

https://gerrit.wikimedia.org/r/696605

ssingh renamed this task from Please create two Ganeti VMs for Wikidough to Please create two Ganeti VMs for Wikidough in esams.May 27 2021, 6:44 PM
Dzahn raised the priority of this task from Medium to High.

Change 697852 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] site: add wikidough esams with insetup role

https://gerrit.wikimedia.org/r/697852

Change 696605 abandoned by Ssingh:

[operations/puppet@production] site: add doh3001 and doh3002 with role insetup

Reason:

merging 697852 instead

https://gerrit.wikimedia.org/r/696605

Change 697852 merged by Dzahn:

[operations/puppet@production] site: add wikidough esams with insetup role

https://gerrit.wikimedia.org/r/697852

Change 697858 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] DHCP: add doh3 to partman regex, add MAC for doh3001

https://gerrit.wikimedia.org/r/697858

Change 697858 merged by Dzahn:

[operations/puppet@production] DHCP: add doh3 to partman regex, add MAC for doh3001

https://gerrit.wikimedia.org/r/697858

cookbooks.sre.hosts.decommission executed by dzahn@cumin1001 for hosts: doh3001.wikimedia.org

  • doh3001.wikimedia.org (WARN)
    • Failed downtime host on Icinga (likely already removed)
    • Found Ganeti VM
    • VM shutdown
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.esams.wmnet to Netbox
    • Removed from DebMonitor
    • Removed from Puppet master and PuppetDB
    • VM removed
    • Started forced sync of VMs in Ganeti cluster ganeti01.svc.esams.wmnet to Netbox

Change 697866 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] DHCP: update MAC address of doh3001 after recreation

https://gerrit.wikimedia.org/r/697866

Change 697866 merged by Dzahn:

[operations/puppet@production] DHCP: update MAC address of doh3001, add doh3002

https://gerrit.wikimedia.org/r/697866

We ran out of resources on esams ganeti (disk). Creating machines with just 10G instead after discussion.

VMs have been created.

doh3001 and doh3002.wikimedia.org are up and running with "insetup". Feel free to use them now.

They have about 1.8GB used and 6.8GB free.

[doh3001:~] $ df -h
Filesystem      Size  Used Avail Use% Mounted on
..
/dev/vda1       8.9G  1.6G  6.8G  19% /


[doh3002:~] $ df -h
Filesystem      Size  Used Avail Use% Mounted on
..
/dev/vda1       8.9G  1.6G  6.8G  19% /
[doh3001:~] $ hostname -f 
doh3001.wikimedia.org


[doh3002:~] $ hostname -f
doh3002.wikimedia.org
Dzahn updated the task description. (Show Details)

Thanks for all the help and sorry it took a while! I think 10G should be fine for now given the current usage on the other Wikidough hosts.