Page MenuHomePhabricator

Q3:rack/setup/install phab1006
Closed, ResolvedPublic

Description

This task will track the racking, setup, and OS installation of X

Hostname / Racking / Installation Details

Hostnames: phab1006.eqiad.wmnet (yea, phab1005 already exists even though this renews 1004)
Racking Proposal: eqiad A - A1
Networking Setup: # of Connections:1 - Speed:1G VLAN:Private
OS Distro: Trixie
Boot Method: Legacy BIOS
Sub-team Technical Contact: Dzahn

Per host setup checklist

Each host should have its own setup checklist copied and pasted into the list below.

phab1006
  • Receive in system on procurement task T417686 & in Coupa
  • Rack system with proposed racking plan (see above) & update Netbox (include all system info plus location, state of planned)
  • Run the Provision a server's network attributes Netbox script - Note that you must run the DNS and Provision cookbook after completing this step
  • Immediately run the sre.dns.netbox cookbook
  • Immediately run the sre.hosts.provision cookbook
  • Run the sre.hardware.upgrade-firmware cookbook
  • Update the operations/puppet repo - this should include updates to preseed.yaml, and site.pp with roles defined by service group: https://wikitech.wikimedia.org/wiki/SRE/Dc-operations
  • Run the sre.hosts.reimage cookbook

Related Objects

StatusSubtypeAssignedTask
ResolvedJclark-ctr

Event Timeline

RobH assigned this task to Dzahn.
RobH mentioned this in Unknown Object (Task).
RobH added a parent task: Unknown Object (Task).
RobH moved this task from Backlog to Racking Tasks on the ops-eqiad board.
RobH unsubscribed.

Please update the site.pp file with the insetup role for your team (detailed on https://wikitech.wikimedia.org/wiki/SRE/Dc-operations) and add the new servers to preseed.yml for partition info.

If possible, please reference this task number in your patch set, so it is clear when complete. Once complete, just un-assign yourself (leaving no assignee) for this task and once the hardware arrives on-site engineerss will claim this task for racking and setup. Please don't re-subscribe me to this task unless there is a direct question for me.

Thank you!

Change #1247660 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] site: add phab1006 with insetup role

https://gerrit.wikimedia.org/r/1247660

Change #1247660 merged by Dzahn:

[operations/puppet@production] site: add phab1006 with insetup role

https://gerrit.wikimedia.org/r/1247660

Dzahn removed Dzahn as the assignee of this task.EditedMar 3 2026, 7:20 PM
Dzahn subscribed.

Thanks. Done! Added to site.pp with insetup role. preseed.yml already covered by a wildcard.

@Dzahn next week can you update puppet this is a uefi only server

@Jclark-ctr Ok, but I'm not sure what kind of update it needs. I never had a UEFI-only server I think.

currently preseed.yaml is

'pki*|phab*':
  - partman/standard.cfg
  - partman/raid1-2dev.cfg

for efi would need

- partman/standard-efi.cfg
- partman/raid1-2dev-efi.cfg

if you want to wait till next week that is fine with me thank you for responding.

@Dzahn if you do make any edits please keep in mind of codfw has same server racked needing same update T418899 phab2003

Change #1270107 had a related patch set uploaded (by Dzahn; author: Dzahn):

[operations/puppet@production] installserver: set UEFI-only recipes for newer phab* hosts

https://gerrit.wikimedia.org/r/1270107

Change #1270107 merged by Dzahn:

[operations/puppet@production] installserver: set UEFI-only recipes for newer phab* hosts

https://gerrit.wikimedia.org/r/1270107

@Jclark-ctr Gotcha! I did make the change. It should be for phab1006, phab2003 and future phab* servers with higher numbers. Done.

Cookbook cookbooks.sre.hosts.reimage was started by jclark@cumin1003 for host phab1006.eqiad.wmnet with OS trixie

Cookbook cookbooks.sre.hosts.reimage started by jclark@cumin1003 for host phab1006.eqiad.wmnet with OS trixie completed:

  • phab1006 (PASS)
    • Removed from Puppet and PuppetDB if present and deleted any certificates
    • Removed from Debmonitor if present
    • Forced UEFI HTTP Boot for next reboot
    • Host rebooted via Redfish
    • Host up (Debian installer)
    • Host up (new fresh trixie OS)
    • Generated Puppet certificate
    • Signed new Puppet certificate
    • Run Puppet in NOOP mode to populate exported resources in PuppetDB
    • Found Nagios_host resource for this host in PuppetDB
    • Downtimed the new host on Icinga/Alertmanager
    • First Puppet run completed and logged in /var/log/spicerack/sre/hosts/reimage/202604131318_jclark_2361809_phab1006.out
    • configmaster.wikimedia.org updated with the host new SSH public key for wmf-update-known-hosts-production
    • Rebooted
    • Automatic Puppet run was successful
    • Forced a re-check of all Icinga services for the host
    • Icinga status is optimal
    • Icinga downtime removed
    • Updated Netbox data from PuppetDB
    • Updated Netbox status planned -> active
    • The sre.puppet.sync-netbox-hiera cookbook was run successfully
Jclark-ctr updated the task description. (Show Details)