Page MenuHomePhabricator

Add paging alert if Toolforge HAProxy connection limit is reached
Closed, ResolvedPublic

Description

If the HAProxy-level frontend connection limit is hit, this means that Toolforge web tools will be unavailable. This is also one of the few situations where the global 5xx error rate alert added in T399870 will not function, as refused TCP connections don't count in the HTTP-level metrics. Thus we should alert if the frontend connection limit is reached.

Details

Related Changes in GitLab:
TitleReferenceAuthorSource BranchDest Branch
web: Alert on frontend connection limitsrepos/cloud/toolforge/alerts!53taavimain-I86527ed9f04909a4273a0f6794990e30cbef906bmain
Customize query in GitLab

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
dcaro triaged this task as High priority.Nov 19 2025, 8:37 AM
dcaro moved this task from To refine to Today on the User-dcaro board.
dcaro added a project: User-dcaro.
dcaro removed dcaro as the assignee of this task.Nov 20 2025, 3:49 PM

will not be able to get to this