Looks like we're fairly close to being able to being finally able to remove Diamond from our stack. Once that happens, we can start thinking about getting rid of the statsd/Graphite service entirely.
Description
Details
Event Timeline
Change 942691 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] P:wmcs::graphite: disable incoming metrics
Change 942692 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] wmcs: Disable Graphite query access
Change 942692 merged by Filippo Giunchedi:
[operations/puppet@production] wmcs: Disable Graphite query access
Change 942691 merged by Filippo Giunchedi:
[operations/puppet@production] P:wmcs::graphite: disable incoming metrics
Mentioned in SAL (#wikimedia-cloud) [2023-08-07T09:39:21Z] <taavi> cloud vps graphite service was disabled: https://wikitech.wikimedia.org/wiki/News/2023_Cloud_VPS_metrics_changes T326266
Change 960027 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/homer/public@master] cr-cloud: Drop cloudmetrics excemptions
Change 960028 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] hieradata: drop dmz_cidr excemptions for cloudmetrics1003/4
Change 960028 merged by Majavah:
[operations/puppet@production] hieradata: drop dmz_cidr excemptions for cloudmetrics1003/4
Change 960027 merged by jenkins-bot:
[operations/homer/public@master] cr-cloud: Drop cloudmetrics excemptions
Mentioned in SAL (#wikimedia-operations) [2023-09-25T07:49:08Z] <taavi> drop cloudmetrics exceptions from cr firewall ACLs https://gerrit.wikimedia.org/r/c/operations/homer/public/+/960027 T326266
Change 960576 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] hieradata: remove more cloudmetrics1003 references
Change 960576 merged by Majavah:
[operations/puppet@production] hieradata: remove more cloudmetrics1003 references
https://gerrit.wikimedia.org/r/960576 broke puppet on deploy-1004.devtools.eqiad1.wikimedia.cloud.
Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Function Call, Class[Profile::Mediawiki::Deployment::Server]: parameter 'statsd' expects a String value, got Undef (file: /etc/puppet/modules/role/manifests/deployment_server.pp, line: 15, column: 5)
class profile::mediawiki::deployment::server in operations/puppet/modules/profile/manifests/mediawiki/deployment/server.pp has a lookup('statsd') call.
I have independently filed it that this morning as T348830: Puppet failure on deploy-1004.devtools.eqiad1.wikimedia.cloud
Change 967898 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/dns@master] wmnet: drop cloudmetrics CNAMEs
Change 967898 merged by Majavah:
[operations/dns@master] wmnet: drop cloudmetrics CNAMEs
Change 973735 had a related patch set uploaded (by Majavah; author: Majavah):
[operations/puppet@production] scap: remove references to cloudmetrics1003/4
Change 973735 merged by Majavah:
[operations/puppet@production] scap: remove references to cloudmetrics1003/4