Maniphest T349795

Upgrade cadvisor
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	taavi
	Oct 26 2023, 7:36 AM

Tags

Referenced Files

None

Subscribers

Description

Cadvisor does not work on the new Containerd based nodes and a quick search suggests this might be fixed by upgrading cadvisor.

Details

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	cadvisor: Update disabled metrics mapping	repos/cloud/toolforge/wmcs-k8s-metrics!7	taavi	taavi/fix-large-metrics	main
	Revert "wmcs-k8s-metrics: rollback tools"	repos/cloud/toolforge/toolforge-deploy!183	taavi	taavi/metrics	main
	upgrade cadvisor	repos/cloud/toolforge/toolforge-deploy!122	taavi	taavi/metrics	main
	chart: update cadvisor to 0.47.2	repos/cloud/toolforge/wmcs-k8s-metrics!4	taavi	taavi/update-cadvisor	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Raymond_Ndibe	T359641 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.27
					Restricted Task
		Resolved		Slst2020	T327025 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.26
		Resolved		• aborrero	T316107 [infra,k8s] Upgrade Toolforge Kubernetes to version 1.25
		Resolved		• aborrero	T307651 Upgrade Toolforge Kubernetes to version 1.24
		Resolved		None	T360699 Toolsbeta: migrate to Debian Bullseye or later
		Resolved		taavi	T311897 [infra] Toolforge: migrate to Debian Bullseye or later
		Resolved		taavi	T311908 Migrate Toolforge Kubernetes hosts to Debian Bullseye or later
		Resolved		• Bstorm	T262550 Toolforge returns HTTP 502 error
		Open		taavi	T262562 [infra] Fix the mis-named k8s service in tools and toolsbeta projects
		Resolved		taavi	T355883 Create a pool of NFS-less Toolforge Kubernetes workers
		Resolved		taavi	T284656 Toolforge k8s: Migrate workers to Containerd and Bookworm
		Resolved		taavi	T349795 Upgrade cadvisor
		Resolved		taavi	T350227 toolforge prometheus servers OOMing

Event Timeline

taavi created this task.Oct 26 2023, 7:36 AM

taavi triaged this task as Medium priority.

taavi updated https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/4

chart: update cadvisor to 0.47.2

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/4

chart: update cadvisor to 0.47.2

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/122

upgrade cadvisor

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/122

upgrade cadvisor

taavi closed this task as Resolved.Oct 30 2023, 2:05 PM

taavi reopened this task as Open.Nov 1 2023, 2:22 PM

taavi added a subtask: T350227: toolforge prometheus servers OOMing.

taavi closed subtask T350227: toolforge prometheus servers OOMing as Resolved.Nov 3 2023, 2:48 PM

dcaro edited projects, added Toolforge (Toolforge iteration 03); removed Toolforge (Toolforge iteration 02).Jan 9 2024, 3:29 PM

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/183

Revert "wmcs-k8s-metrics: rollback tools"

taavi moved this task from Next Up to In Review on the Toolforge (Toolforge iteration 03) board.Jan 23 2024, 2:07 PM

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/183

Revert "wmcs-k8s-metrics: rollback tools"

taavi opened https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/7

cadvisor: Update disabled metrics mapping

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/wmcs-k8s-metrics/-/merge_requests/7

cadvisor: Update disabled metrics mapping

project_1317_bot_df3177307bed93c3f34e421e26c86e38 opened https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/185

wmcs-k8s-metrics: bump to 0.0.18-20240123190739-bb982183

taavi merged https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/185

wmcs-k8s-metrics: bump to 0.0.18-20240123190739-bb982183

dcaro edited projects, added Toolforge (Toolforge iteration 04); removed Toolforge (Toolforge iteration 03).Jan 24 2024, 9:16 AM

dcaro moved this task from Next Up to In Review on the Toolforge (Toolforge iteration 04) board.

Let's call this done. We're back to normal memory usage after the upgrade.

taavi edited projects, added Toolforge (Toolforge iteration 03); removed Toolforge (Toolforge iteration 04).Jan 24 2024, 9:17 AM

taavi moved this task from In Review to Done on the Toolforge (Toolforge iteration 03) board.