| xcollazo | |
| Oct 3 2025, 6:28 PM |
| F66750006: Screenshot 2025-10-14 at 15.35.43.png | |
| Oct 14 2025, 1:35 PM |
In T389773: Adjust maximum number of mapped tasks in the airflow instance we upped the max mapped task to 1200, but only for the test_k8s instance.
On the main instance, we have multiple DAGs that map by wiki_id, and thus currently at ~883 tasks.
Let's make that former bump a global setting that applies to all instances and proactively take care of this potential issue.
This would we needed as well for T404084: Move the dumps_v1 DAGs from the Airflow test_k8s instance to a dedicated instance.
| Subject | Author | Repo | Branch | Lines +/- | |
|---|---|---|---|---|---|
| airflow: increase max_map_length from 1024 to 1200 | Brouberol | operations/deployment-charts | master | +2 -0 |
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T366752 Dumps 2.0 Phase III: Production level dumps (SDS 1.2) | |||
| Resolved | brouberol | T406371 Bump max mapped task for all Airflow instances to 1200 |
Change #1195985 had a related patch set uploaded (by Brouberol; author: Brouberol):
[operations/deployment-charts@master] airflow-main: increase max_map_length from 1024 to 1200
Change #1196026 had a related patch set uploaded (by Brouberol; author: Brouberol):
[operations/deployment-charts@master] airflow: set the default DAG parsing interval to 300s
Change #1195985 merged by Brouberol:
[operations/deployment-charts@master] airflow: increase max_map_length from 1024 to 1200
