confirmed all green in IDRAC

@hnowlan looks like an IDRAC reset and firmware upgrade too on this server will fix the issue

@hashar no problem you can close the task once all is back online.

reset IDRAC, uograde BIOS and IDRAC.

@hashar let me know when this is offline so i can take over

PS2 replaced

@hashar since Monday is a Holiday, let is do this on the 18th at 10am CT. Thanks

The IDRAC on this server needs reset. Please coordinate a day and time that is best for this server to be taken off line.

@Jclark-ctr thanks make sense

@Jclark-ctr looking at the image you shared at https://usercontent.irccloud-cdn.com/file/5YslcsIX/1641945459.JPG i see you are using orange cables to msw2 and not to the console server. We use orange cables for console and green cables for mgmt. Any reason why we are using orange cables in this case?`

thanks @Dzahn

This is ready but according to @jbond, it still has some puppet errors but that looks like it is related to this puppet policy not being ready for debian bullseye.

@Dzahn no

Checked the server today no error so far on DIMM B1, closing the task. if we have the problem we can re-open the task.

Disk replaced

@Gehel we have some disks that we took out from decom servers I will look when i am back on site tomorrow if we can find one.

I swapped DIMM A1 wiht DIMM B1 to see if the error shows on B1. I am leaving the task open for now .

You have successfully submitted request SR1080456967

@Vgutierrez Happy new year can I power this server off so I can swap DIMM A1 with DIMM B1?

Tracking information

@fgiunchedi disk replaced

Current Status:

@MoritzMuehlenhoff no problem closing this task now

Create Dispatch: Success
You have successfully submitted request SR1079308386.

@MoritzMuehlenhoff complete

This is complete

@jcrespo this is complete

The was a breaker problem . This is now resolved

@aborrero are we doing trunk so i can assign this task to netops?

The 2nd NIC is connected to port ge-1/0/34 only thing left is to do the config in Netbox.

This is complete.

@aborrero can we test this for now on only one server to see if it works before moving it to the other servers?

John went back to check, it was a loose power cable. All good now. resolving this .

I create Order # 1-214270167279 to be on site next week on the 14th at 3:00 PM to meet with the Equinix smart hands tech to perform the troubleshooting while i am on site.

After putting in the new PDU's we still have the same problem.

This is complete

This is complete

@Marostegui @Kormat all the servers are back up online from my end.

This was shipped today.

@elukey
Replaced the cable

Interface       Admin Link Description
ge-6/0/4        up    up   ml-serve2004``

note: If ml-serve200[1-4] are in service can you please change the status in Network from Stage to active?

Thanks guys

@ayounsi thank you

I prefer to just reuse/extent the task by adding the nodes in the description like i did for ganeti2009 and 2010 so we keep better tack.