Adjust webserver resources
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	brouberol
	Apr 30 2025, 8:24 AM

Description

The large dump DAGs might take up a lot of memory to visualize. Let's adjust the webserver resource requirements if needed.

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	airflow-test-k8s: double the request/limit memory of the webserver	operations/deployment-charts	master	+6 -0

Status	Assigned	Task
Open	None	T88728 Improve Wikimedia dumping infrastructure
Resolved	BTullis	T352650 WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes
Resolved	brouberol	T388378 Orchestrate dumps v1 from an airflow instance
Resolved	brouberol	T390945 Run an experimental dump of 200 regular sized wikis
Resolved	brouberol	T392987 Adjust webserver resources

brouberol triaged this task as Medium priority.

Change #1140128 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] airflow-test-k8s: double the request/limit memory of the webserver

We see that 2GB of memory is cutting it a bit short when visualizing/clearing the dump DAGs:

brouberol changed the task status from Open to In Progress.Apr 30 2025, 8:25 AM

brouberol claimed this task.

Change #1140128 merged by Brouberol:

[operations/deployment-charts@master] airflow-test-k8s: double the request/limit memory of the webserver

	F59577331: Screenshot 2025-04-30 at 10.24.54.png
	Apr 30 2025, 8:25 AM