Maniphest T397039

Set a proper DAG run timeout on the dump DAGs
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	brouberol
	Jun 16 2025, 1:34 PM

Tags

Referenced Files

None

Subscribers

Description

As the default DAG run timeout is 7 days, we need to adjust that value to enable the dumps DAGs to run as long as possible.

Details

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	test_k8s/dumps: set a DAG run timeout on all dumps dags	repos/data-engineering/airflow-dags!1411	brouberol	T397039	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T88728 Improve Wikimedia dumping infrastructure
		Resolved		BTullis	T352650 WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes
		Resolved		brouberol	T388378 Orchestrate dumps v1 from an airflow instance
		Resolved		brouberol	T397039 Set a proper DAG run timeout on the dump DAGs

Event Timeline

brouberol created this task.Jun 16 2025, 1:34 PM

brouberol triaged this task as Medium priority.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 16 2025, 1:34 PM

brouberol changed the task status from Open to In Progress.Jun 16 2025, 1:34 PM

brouberol claimed this task.

brouberol moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.

brouberol edited projects, added Data-Platform-SRE (2025.06.13 - 2025.07.04); removed Data-Platform-SRE.

brouberol merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1411

test_k8s/dumps: set a DAG run timeout on all dumps dags

brouberol closed this task as Resolved.Jun 16 2025, 1:48 PM

brouberol moved this task from In Progress to Done on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.

Gehel moved this task from Done to Reported on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.Jun 20 2025, 8:53 AM