We noticed that when the statsd server name changed to cloudmetrics1001, this service failed, which prevented grid-based webservices from being restarted. Since the metrics servers are a pair, this seems like a bad design.
We also didn't notice the problem for some time, which suggests these are not high-value metrics.
| Subject | Repo | Branch | Lines +/- | |
|---|---|---|---|---|
| tools-manifests: don't collect statsd metrics | operations/software/tools-manifest | master | +1 -26 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T194333 [Epic] Provide logging/metrics/monitoring SaaS for Cloud VPS tenants | |||
| Resolved | aborrero | T244809 Remove or fix stats collecting from tools-manifest (webservice-monitor) |
Change 889085 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):
[operations/software/tools-manifest@master] tools-manifests: don't collect statsd metrics
Change 889085 merged by jenkins-bot:
[operations/software/tools-manifest@master] tools-manifests: don't collect statsd metrics
Mentioned in SAL (#wikimedia-cloud) [2023-02-14T12:02:53Z] <arturo> included tools-manifests 0.25 in toolsbeta-buster aptly repo (T329611, T329467, T244809)
Mentioned in SAL (#wikimedia-cloud) [2023-02-14T12:09:57Z] <arturo> included tools-manifests 0.25 in tools-buster aptly repo, deploying it now! (T329611, T329467, T244809)