GerritHAProxyServiceUnavailable
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	phaultfinder
	Feb 16 2026, 10:11 AM

Description

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in codfw.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in codfw
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: codfw
source: prometheus
state: DOWN
team: collaboration-services
Source

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in drmrs.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in drmrs
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: drmrs
source: prometheus
state: DOWN
team: collaboration-services
Source

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in eqiad.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in eqiad
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: eqiad
source: prometheus
state: DOWN
team: collaboration-services
Source

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in eqsin.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in eqsin
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: eqsin
source: prometheus
state: DOWN
team: collaboration-services
Source

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in esams.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in esams
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: esams
source: prometheus
state: DOWN
team: collaboration-services
Source

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in magru.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in magru
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: magru
source: prometheus
state: DOWN
team: collaboration-services
Source

dashboard: grafana.wikimedia.org/d/459365f6-df37-48d6-8142-82b22c1875e7/gerrit-tcp-proxy?viewPanel=panel-15
description: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN, less than 2 available proxies in ulsfo.
runbook: https://wikitech.wikimedia.org/wiki/Gerrit/Operations#GerritHAProxyServiceUnavailable
summary: Gerrit tcp-proxy (HAProxy) service gerrit_ssh is DOWN in ulsfo
alertname: GerritHAProxyServiceUnavailable
job: tcp_proxy
prometheus: ops
proxy: gerrit_ssh
severity: task
site: ulsfo
source: prometheus
state: DOWN
team: collaboration-services
Source

Status	Assigned	Task
Open	None	T407557 OpenSSH 10.1+ warns that Wikimedia SSH does not use post-quantum key exchange algorithm
Open	None	T407844 Gerrit ssh daemon does not offer post-quantum kex leading to a warning with OpenSSH 10
		Restricted Task
Open	None	T392448 Upgrade to Gerrit 3.12
Open	None	T379714 Upgrade to Gerrit 3.11
Open	None	T392465 Switch Gerrit from Java 17 to Java 21
Open	None	T384595 Upgrade Collab hosts to Bookworm
Resolved	ABran-WMF	T392464 Upgrade Gerrit hosts from Bullseye to Bookworm
Open	None	T387831 Standardize failover procedures for Collab services
Resolved	None	T393239 ProbeDown
Resolved	ABran-WMF	T387833 Gerrit switchover process
Resolved	ABran-WMF	T417566 GerritHAProxyServiceUnavailable