Fix prometheus monitoring for Toolforge Ingress
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	• Bstorm
	Jun 4 2021, 9:35 PM

Description

After T264221 created a new ingress for Toolforge, we stopped getting a lot of prometheus metrics.

We should figure out what needs to change to get that working again--best before PAWS is set up with it.

Details

	Subject	Repo	Branch	Lines +/-
	Fix prometheus monitoring for Toolforge Ingress	operations/puppet	production	+1 -1
	Fix prometheus monitoring for Toolforge Ingress	operations/puppet	production	+2 -2

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T362869 [k8s,infra] Upgrade Toolforge to Uwubernetes (1.30)
Open	None	T362868 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.29
Open	None	T362867 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.28
Open	None	T359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
Open	None	T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
Open	None	T316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
Resolved	aborrero	T307651 Upgrade Toolforge Kubernetes to version 1.24
Resolved	taavi	T298005 Upgrade Toolforge Kubernetes to version 1.23
Resolved	taavi	T286856 Upgrade Toolforge Kubernetes to latest 1.22
Resolved	rook	T308172 Upgrade PAWS to Kubernetes 1.21
Resolved	taavi	T282942 Upgrade Toolforge Kubernetes to latest 1.21
Resolved	rook	T291913 Upgrade PAWS kubernetes to 1.20
Resolved	rook	T280402 Upgrade Toolforge Kubernetes to latest 1.20
Resolved	taavi	T280340 Upgrade Toolforge Kubernetes to latest 1.19
Resolved	taavi	T280299 Upgrade Toolforge Kubernetes to latest 1.18
Resolved	taavi	T280302 Upgrade PAWS Kubernetes to the latest 1.18 release
		Restricted Task
Resolved	• Bstorm	T246122 Upgrade the Toolforge Kubernetes cluster to v1.16
Resolved	• Bstorm	T263284 Upgrade Toolforge K8s to 1.17
Resolved	taavi	T264221 Upgrade the nginx ingress controller in Toolforge (and likely PAWS)
Resolved	taavi	T284353 Fix prometheus monitoring for Toolforge Ingress

Event Timeline

• Bstorm created this task.Jun 4 2021, 9:35 PM

• Bstorm added a comment.Jun 4 2021, 9:47 PM

This comment was removed by • Bstorm.

It is invalid. There's just something weird about some grafana dashboards. The stats are coming in.

Spoke too soon. I was seeing something different. The stats are not being generated for Toolforge. The ingress stats are only being generated for PAWS.

Change 698578 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] Fix prometheus monitoring for Toolforge Ingress

https://gerrit.wikimedia.org/r/698578

gerritbot added a project: Patch-For-Review.Jun 7 2021, 5:26 PM

Change 698578 merged by Bstorm:

[operations/puppet@production] Fix prometheus monitoring for Toolforge Ingress

https://gerrit.wikimedia.org/r/698578

Maintenance_bot removed a project: Patch-For-Review.Jun 7 2021, 7:10 PM

@Bstorm Could you make sure the puppet change works as expected before closing this?

Change 699484 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] Fix prometheus monitoring for Toolforge Ingress

https://gerrit.wikimedia.org/r/699484