We should include a kube-state-metrics deployment into each of our clusters to be able to collect metrics about the state of API objects. That would help us more easily gather information on things like deployments happening (T222826) or containers not being killed/restarted often (T256256).
For this we need to (at least):
- Build a kube-state-metrics docker image and push to our registry
- Include the helm chart in the admin area of deployment-chart repo
As this will generate a lot of extra metrics, we should probably talk to o11y.