Received a page which almost immediately recovered, no signs of network troubles though:
Service: LVS HTTPS IPv4 #page Host: text-lb.ulsfo.wikimedia.org Address: 198.35.26.96 State: CRITICAL Date/Time: Sat Nov 23 09:02:16 UTC 2019
Notification Type: RECOVERY Service: LVS HTTPS IPv4 #page Host: text-lb.ulsfo.wikimedia.org Address: 198.35.26.96 State: OK Date/Time: Sat Nov 23 09:03:57 UTC 2019
Upon further investigation it looks like LVS paging checks for text-lb have been alerting in SOFT state for the last few hours: https://logstash.wikimedia.org/goto/34bbf6a96cf59e2f4951dfc4474ec00e (icinga AND text-lb AND "service alert") and I suspect the page was a (un)lucky coincidence that the check failed three times in a row.
The failing checks seem to correlate with a general spike in GET latency for appservers, jumping up on the 23rd at ~00.00: https://grafana.wikimedia.org/d/RIA1lzDZk/application-servers-red-dashboard?orgId=1&from=1574329628748&to=1574502428749&var-datasource=eqiad%20prometheus%2Fops&var-cluster=appserver&var-method=GET&panelId=10&fullscreen&var-code=200
