Maniphest T368515

toolforge: kyverno: enable monitoring
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• aborrero
	Jun 26 2024, 9:11 AM

Tags

Referenced Files

None

Subscribers

Description

We can:

enable prometheus metrics
have some grafana dashboards
have some basic alerts
have some basic runbooks

See upstream docs: https://kyverno.io/docs/monitoring/

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	toolforge: prometheus: scrape kyverno metrics	operations/puppet	production	+6 -0

Customize query in gerrit

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	kyverno: only deploy on tools for now	repos/cloud/toolforge/alerts!18	aborrero	arturo-256-kyverno-only-deploy	main
	kubernetes: add some basic kyverno alerts	repos/cloud/toolforge/alerts!17	aborrero	arturo-136-kubernetes-add-some	main
	kyverno: enable prometheus monitoring	repos/cloud/toolforge/toolforge-deploy!377	aborrero	arturo-251-kyverno-enable-prom	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Raymond_Ndibe	T359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
					Restricted Task
		Resolved		Slst2020	T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
		Resolved		• aborrero	T316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
		Resolved		• aborrero	T279110 [infra] Replace PodSecurityPolicy in Toolforge Kubernetes
		Resolved		• aborrero	T368515 toolforge: kyverno: enable monitoring

Event Timeline

• aborrero created this task.Jun 26 2024, 9:11 AM

• aborrero moved this task from Backlog to Next on the User-aborrero board.Jul 2 2024, 11:40 AM

• aborrero moved this task from Next to Doing on the User-aborrero board.Jul 2 2024, 11:58 AM

• aborrero updated the task description. (Show Details)

• aborrero changed the task status from Open to In Progress.Jul 2 2024, 12:00 PM

• aborrero claimed this task.

• aborrero triaged this task as Medium priority.

aborrero opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/377

kyverno: enable prometheus monitoring

aborrero closed https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/377

kyverno: enable prometheus monitoring

Maintenance_bot removed a project: Patch-For-Review.Jul 2 2024, 12:31 PM

Change #1051351 had a related patch set uploaded (by Arturo Borrero Gonzalez; author: Arturo Borrero Gonzalez):

[operations/puppet@production] toolforge: prometheus: scrape kyverno metrics

https://gerrit.wikimedia.org/r/1051351

gerritbot added a project: Patch-For-Review.Jul 2 2024, 12:34 PM

Change #1051351 merged by Arturo Borrero Gonzalez:

[operations/puppet@production] toolforge: prometheus: scrape kyverno metrics

https://gerrit.wikimedia.org/r/1051351

created dashboard: https://grafana-rw.wmcloud.org/d/kyverno/kyverno?orgId=1&var-DS_PROMETHEUS_KYVERNO=prometheus-tools

• aborrero updated the task description. (Show Details)Jul 2 2024, 12:53 PM

• aborrero edited projects, added Toolforge (Toolforge iteration 11); removed Toolforge.Jul 2 2024, 1:12 PM

• aborrero moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 11) board.

Maintenance_bot removed a project: Patch-For-Review.Jul 2 2024, 1:32 PM

dcaro edited projects, added Toolforge (Toolforge iteration 12); removed Toolforge (Toolforge iteration 11).Jul 2 2024, 2:00 PM

dcaro moved this task from Next Up to In Progress on the Toolforge (Toolforge iteration 12) board.

aborrero opened https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/17

kubernetes: add some basic kyverno alerts

aborrero merged https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/17

kubernetes: add some basic kyverno alerts

Expanded information at https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/Kyverno

• aborrero closed this task as Resolved.Jul 5 2024, 3:37 PM

aborrero opened https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/18

kyverno: only deploy on tools for now

aborrero merged https://gitlab.wikimedia.org/repos/cloud/toolforge/alerts/-/merge_requests/18

kyverno: only deploy on tools for now

Maintenance_bot removed a project: Patch-For-Review.Jul 9 2024, 8:42 PM

dcaro moved this task from In Progress to Done on the Toolforge (Toolforge iteration 12) board.Jul 16 2024, 1:21 PM