We don't use the mod anymore since we're now behind CDN.
We can keep the mtail configuration that brings a bit more granularity on metrics than what we initially had and remove the mod.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| gerrit: clean up post mod_qos removal | operations/puppet | production | +0 -12 | |
| gerrit: remove mod_qos | operations/puppet | production | +20 -471 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | ABran-WMF | T406005 train-presync failed due to git clone failing with gnutls_handshake() failure | |||
| Resolved | ABran-WMF | T406017 gerrit: mod_qos allowlist and monitoring improvements | |||
| Resolved | ABran-WMF | T417615 remove mod_qos on Gerrit |
Change #1248843 had a related patch set uploaded (by Arnaudb; author: Arnaudb):
[operations/puppet@production] gerrit: remove mod_qos
Change #1248843 merged by Arnaudb:
[operations/puppet@production] gerrit: remove mod_qos
After applying the change on gerrit-spare:
arnaudb@gerrit2002:~ $ curl -sSL localhost:3903/metrics|rg -i http_status
# HELP apache_http_status_total defined at httpd.mtail:3:9-32
# TYPE apache_http_status_total counter
apache_http_status_total{method="GET",prog="httpd.mtail",status="301"} 1
apache_http_status_total{method="GET",prog="httpd.mtail",status="302"} 1
apache_http_status_total{method="GET",prog="httpd.mtail",status="404"} 2httpd: restarts properly
gerrit: serves its webpage
I'll move on to gerrit-replica
gerrit-replica updated. I'll let the change sit for a while and move on to the primary instance.
arnaudb@gerrit1003:~ $ curl -sSL localhost:3903/metrics|rg -i http_status
# HELP apache_http_status_total defined at httpd.mtail:3:9-32
# TYPE apache_http_status_total counter
apache_http_status_total{method="GET",prog="httpd.mtail",status="200"} 80
apache_http_status_total{method="GET",prog="httpd.mtail",status="301"} 1
apache_http_status_total{method="GET",prog="httpd.mtail",status="302"} 1
apache_http_status_total{method="GET",prog="httpd.mtail",status="404"} 4
apache_http_status_total{method="POST",prog="httpd.mtail",status="200"} 77the change has also been applied to the primary instance:
arnaudb@gerrit2003:~ $ curl -sSL localhost:3903/metrics|rg -i http_status
# HELP apache_http_status_total defined at httpd.mtail:3:9-32
# TYPE apache_http_status_total counter
apache_http_status_total{method="GET",prog="httpd.mtail",status="200"} 143
apache_http_status_total{method="GET",prog="httpd.mtail",status="204"} 2
apache_http_status_total{method="GET",prog="httpd.mtail",status="302"} 9
apache_http_status_total{method="GET",prog="httpd.mtail",status="401"} 1
apache_http_status_total{method="GET",prog="httpd.mtail",status="403"} 5
apache_http_status_total{method="GET",prog="httpd.mtail",status="404"} 2
apache_http_status_total{method="POST",prog="httpd.mtail",status="200"} 97without trouble.
This can be considered as resolved, mod_qos is gone!
Change #1249221 had a related patch set uploaded (by Arnaudb; author: Arnaudb):
[operations/puppet@production] gerrit: clean up post mod_qos removal
Change #1249221 merged by Arnaudb:
[operations/puppet@production] gerrit: clean up post mod_qos removal