Page MenuHomePhabricator

Elevated 99p RESBase storage latencies latencies
Closed, ResolvedPublic

Description

99p latencies for RESTBase used to run rather consistently below the 500ms mark, and are now averaging close to 1 second.

Last weeks 2.2.6 upgrades (July 12-14) created noticeable impact, even more so the removenode of 1014 on Friday (July 15), with effects carrying into the weekend. That said the upward trend appears to have started much earlier.

latency.png (694×1 px, 84 KB)

Mean and median latencies continue to look quite good, but we should look into these 99p latencies before they get any worse.