Paste P8785

esams L3 wave recent history
ActivePublic
Actions

Authored by BBlack on Jul 23 2019, 4:41 PM.

Tags

Referenced Files

	F29850905: raw.txt
	Jul 23 2019, 4:41 PM

Subscribers

None

	Interface down->up events in librenms, looking at both sides of the Level 3 wave from esams to eqiad:

	Where both sides reported the issue, the outermost timestamps for linkdown/linkup from both are used.
	Where only one side reports, it's noted afterwards.

	2019-07-23 15:55:35 -> Ongoing - (45 mins and counting right now)
	2019-07-22 06:45:35 -> 07:17:18 - ~30 mins
	2019-07-18 22:22:28 -> 22:27:02 - ~5 mins (only in logs on US side)
	2019-07-12 07:42:23 -> 07:47:18 - ~5 mins (only in logs on US side)
	2019-07-09 08:50:35 -> 08:55:34 - ~5 mins (only in logs on EU side)
	2019-07-09 06:30:34 -> 07:02:18 - ~30 mins
	2019-06-29 07:07:20 -> 07:12:21 - ~5 mins (only in logs on US side)

Event Timeline

BBlack created this paste.Jul 23 2019, 4:41 PM

elukey mentioned this in T228827: Instability of the Level3 link between cr2-eqiad and cr2-esams.Jul 24 2019, 6:25 AM