Page MenuHomePhabricator
Create Task
Maniphest T392470

Increase mediawiki-dumps-legacy namespace quotas to enable running 32 parallel pods
Closed, ResolvedPublic
Actions

Description

As visible on the Kubernetes - Resources quotas dashboard, we've hit some quotas when attempting to run 32 parallel dump jobs.

We need to increase the limit CPU and memory quotas by a bit to leave us more room.

Details

Related Changes in Gerrit:
SubjectRepoBranchLines +/-
mediawiki-dumps-legacy: increase the memory/cpu limit quotasoperations/deployment-chartsmaster+8 -8
airflow-test-k8s: increase the memory/cpu limit quotasoperations/deployment-chartsmaster+8 -0
Customize query in gerrit

Related Objects
Search...

Event Timeline

brouberol created this task.Apr 23 2025, 11:12 AM
brouberol triaged this task as Medium priority.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 23 2025, 11:12 AM
gerritbot added a comment.Apr 23 2025, 11:14 AM

Change #1138314 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] airflow-test-k8s: increase the memory/cpu limit quotas

https://gerrit.wikimedia.org/r/1138314

gerritbot added a project: Patch-For-Review.Apr 23 2025, 11:14 AM
brouberol changed the task status from Open to In Progress.Apr 23 2025, 11:14 AM
brouberol moved this task from Backlog - project to Needs Review on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.
brouberol edited projects, added: Data-Platform-SRE (2025.04.12 - 2025.05.02); removed: Data-Platform-SRE.
gerritbot added a comment.Apr 23 2025, 12:34 PM

Change #1138314 merged by Brouberol:

[operations/deployment-charts@master] airflow-test-k8s: increase the memory/cpu limit quotas

https://gerrit.wikimedia.org/r/1138314

brouberol closed this task as Resolved.Apr 23 2025, 12:36 PM
brouberol claimed this task.
brouberol moved this task from Needs Review to Done on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.
brouberol added a comment.Apr 23 2025, 12:59 PM

Reopening, as the pods are created in the mediawiki-dumps-legacy namespace.

brouberol reopened this task as In Progress.Apr 23 2025, 12:59 PM
brouberol moved this task from Done to In Progress on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.
gerritbot added a comment.Apr 23 2025, 1:00 PM

Change #1138348 had a related patch set uploaded (by Brouberol; author: Brouberol):

[operations/deployment-charts@master] mediawiki-dumps-legacy: increase the memory/cpu limit quotas

https://gerrit.wikimedia.org/r/1138348

brouberol renamed this task from Increase airflow-test-k8s namespace quotas to enable running 32 parallel pods to Increase mediawiki-dumps-legacy namespace quotas to enable running 32 parallel pods.Apr 23 2025, 1:01 PM
gerritbot added a comment.Apr 23 2025, 1:07 PM

Change #1138348 merged by Brouberol:

[operations/deployment-charts@master] mediawiki-dumps-legacy: increase the memory/cpu limit quotas

https://gerrit.wikimedia.org/r/1138348

Maintenance_bot removed a project: Patch-For-Review.Apr 23 2025, 1:30 PM
brouberol closed this task as Resolved.Apr 24 2025, 6:52 AM
brouberol moved this task from In Progress to Done on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.
BTullis moved this task from Done to Reported on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.May 1 2025, 4:25 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits