Change Details

I detected this when rebooting the server: ``` Enumerating Boot options... Enumerating Boot options... Done UEFI0067: A PCIe link training failure is observed in Slot1 and the link is disabled. Do one of the following: 1) Turn off the input power to the system and turn on again. 2) Update the PCIe device firmware. If the issue persists, contact your service provider. Available Actions: F1 to Continue and Retry Boot Order F2 for System Setup (BIOS) F10 for Lifecycle Controller - Enable/Configure iDRAC - Update or Backup/Restore Server Firmware - Help Install an Operating System F11 for Boot Manager ``` The server wont boot. === DC Ops troubleshooting == I've not seen this, but unless it happens twice it doesn't count! So, steps to fix: [[ https://netbox.wikimedia.org/dcim/devices/2746/ | cloudvirt1038 ]] is located in D5:U14 [x] onsite unplugs all power, fully depowering the system. Then plug back in after 15-30 seconds and attempt to boot the system. [] If that works, resolve this task as it only happened once and thus isn't worth spending more time on. [x] If that does not work, you can reassign this task back to Rob and he'll flash firmware updates across the host remotely. [] firmware update **When the system is booting successfully again, please change the 'failed' state in netbox back to 'active'.**

I detected this when rebooting the server: ``` Enumerating Boot options... Enumerating Boot options... Done UEFI0067: A PCIe link training failure is observed in Slot1 and the link is disabled. Do one of the following: 1) Turn off the input power to the system and turn on again. 2) Update the PCIe device firmware. If the issue persists, contact your service provider. Available Actions: F1 to Continue and Retry Boot Order F2 for System Setup (BIOS) F10 for Lifecycle Controller - Enable/Configure iDRAC - Update or Backup/Restore Server Firmware - Help Install an Operating System F11 for Boot Manager ``` The server wont boot. === DC Ops troubleshooting == I've not seen this, but unless it happens twice it doesn't count! So, steps to fix: [[ https://netbox.wikimedia.org/dcim/devices/2746/ | cloudvirt1038 ]] is located in D5:U14 [x] onsite unplugs all power, fully depowering the system. Then plug back in after 15-30 seconds and attempt to boot the system. - did not fix error [x] update firmware: idrac, bios, network card (only item on pcie bus) - did not fix error [] - open task with dell support, have them dispatch a tech (see note below) tech note: This error will require some troubleshooting with the network card, the PCIe riser, and the mainboard. This can be done by our own on-sites, or we can leverage our warranty coverage to have Dell send out a technician. Trying to do this via self dispatch will be cumbersome, as its unclear where to start. The options are to have an on-site self dispatch parts and work with Dell support via email to determine what parts and how to fix, or to have an on-site call into dell support and schedule a dell technician to come out and work on this in warranty host to determine what part is wrong. **When the system is booting successfully again, please change the 'failed' state in netbox back to 'active'.**

I detected this when rebooting the server: ``` Enumerating Boot options... Enumerating Boot options... Done UEFI0067: A PCIe link training failure is observed in Slot1 and the link is disabled. Do one of the following: 1) Turn off the input power to the system and turn on again. 2) Update the PCIe device firmware. If the issue persists, contact your service provider. Available Actions: F1 to Continue and Retry Boot Order F2 for System Setup (BIOS) F10 for Lifecycle Controller - Enable/Configure iDRAC - Update or Backup/Restore Server Firmware - Help Install an Operating System F11 for Boot Manager ``` The server wont boot. === DC Ops troubleshooting == I've not seen this, but unless it happens twice it doesn't count! So, steps to fix: [[ https://netbox.wikimedia.org/dcim/devices/2746/ | cloudvirt1038 ]] is located in D5:U14 [x] onsite unplugs all power, fully depowering the system. Then plug back in after 15-30 seconds and attempt to boot the system. - did not fix error [] If that worksx] update firmware: idrac, bios, resolve this task as it network card (only happened once and thus isn't worth spending more time on.item on pcie bus) - did not fix error [x] If that does not work] - open task with dell support, have them dispatch a tech (see note below) tech note: This error will require some troubleshooting with the network card, the PCIe riser, and the mainboard. This can be done by our own on-sites, or we can leverage our warranty coverage to have Dell send out a technician. Trying to do this via self dispatch will be cumbersome, you can reassign this task back to Rob and he'll flash firmware updates across the host remotely. [] firmware updateas its unclear where to start. The options are to have an on-site self dispatch parts and work with Dell support via email to determine what parts and how to fix, or to have an on-site call into dell support and schedule a dell technician to come out and work on this in warranty host to determine what part is wrong. **When the system is booting successfully again, please change the 'failed' state in netbox back to 'active'.**