Page MenuHomePhabricator

Replag of S1, S3, and S5 are over 2.75 hours
Closed, ResolvedPublic

Description

Originally reported as T177492 with regard to XTools.

S1, S3, and S5 are reporting high replag according to heartbeat_p on Labs.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

It has been fixed already, it should be slowly recovering.

As a reminder, new replicas are more likely to be up to date than old ones (see they have 0 lag)- this is not on purpose- but newer hardware and extra redundancy make easier to recover from problems coming from production like this one. So please start using the new hosts ASAP, they are both faster and more reliable.

It has been fixed already, it should be slowly recovering.

Cool!

As a reminder, new replicas are more likely to be up to date than old ones (see they have 0 lag)- this is not on purpose- but newer hardware and extra redundancy make easier to recover from problems coming from production like this one. So please start using the new hosts ASAP, they are both faster and more reliable.

XTools actually is. I simply opened this task because I saw lag on the old systems. We're looking at removing our replag notification from the web interface soon.

Marostegui claimed this task.

Closing this as the lag is gone as per replag
Sorry for the inconveniences this might have caused!