Page MenuHomePhabricator

Incident report for WMCH server "members2" (2020-11-20)
Closed, ResolvedPublic

Description

In 2020-11-20 16:48 CET we noticed the Wikimedia CH's server called members2 was down and we are not able to ping, receive HTTP/HTTPs responses or connect via SSH in any way.

Details about members2:

Here the intervention report in CET:

  • 2020-11-20 14:52: Identified downtime. Opened a ticket to our service provider (ticket ID CUSTOMER-5291).
  • 2020-11-20 15:05: Reply from service provider. From their side the virtual machine is running and no further detail. They tried a reboot, resolving temporary.
  • 2020-11-20 15:08: We closed the ticket.
  • 2020-11-20 16:48: Identified downtime again. Re-opened ticket.
  • 2020-11-20 17:32: Reply from service provider. From their side the virtual machine was running.
  • 2020-11-20 17:53: We provided further details about our complete inability to access the service.
  • 2020-11-20 18:36: They tried another reboot.
  • 2020-11-21 00:36: We confirmed the downtime was subsisting.
  • 2020-11-24 13:22: They proposed to enter via SSH because they could connect and try to investigate. They asked SSH credentials.
  • 2020-11-25 19:11: The WMCH community manager confirmed the downtime was still subsisting from our side.
  • 2020-11-26 10:39: The service provider announced the problem was fixed.
  • 2020-11-26 11:18: Requested incident details.
  • 2020-11-26 13:35: Provided incident details: issue in network interface configuration provided by the service provider.

Ticket URL (private):

{P13356}

Event Timeline

valerio.bozzolan renamed this task from WMCH server "members2" is down to Incident report for WMCH server "members2" (2020-11-21).Nov 20 2020, 11:59 PM
valerio.bozzolan claimed this task.
valerio.bozzolan created this task.
valerio.bozzolan renamed this task from Incident report for WMCH server "members2" (2020-11-21) to Incident report for WMCH server "members2" (2020-11-20).Nov 21 2020, 12:03 AM
valerio.bozzolan updated the task description. (Show Details)
valerio.bozzolan updated the task description. (Show Details)
valerio.bozzolan moved this task from Working On to Recent Changes on the WMCH-Infrastructure board.

We can consider this incident report as complete. Mark as resolved.