Maniphest T389759

Document the dumps v1 on airflow infrastructure
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	brouberol
	Mar 24 2025, 9:27 AM

Tags

Referenced Files

None

Subscribers

Description

We need to write a wiki page describing how the dumps v1 commands are scheduled and run on Airflow

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Open		None	T88728 Improve Wikimedia dumping infrastructure
		Resolved		BTullis	T352650 WE 5.4 KR - Hypothesis 5.4.4 - Q3 FY24/25 - Migrate current-generation dumps to run on kubernetes
		Resolved		brouberol	T388378 Orchestrate dumps v1 from an airflow instance
		Resolved		brouberol	T389759 Document the dumps v1 on airflow infrastructure

Event Timeline

brouberol created this task.Mar 24 2025, 9:27 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 24 2025, 9:27 AM

Gehel triaged this task as Medium priority.Mar 26 2025, 9:46 AM

Gehel added a parent task: T388378: Orchestrate dumps v1 from an airflow instance.

Gehel moved this task from Incoming to Scratch on the Data-Platform-SRE board.

Gehel moved this task from Scratch to Quarterly Goals on the Data-Platform-SRE board.Mar 26 2025, 9:50 AM

WIP in https://wikitech.wikimedia.org/wiki/Dumps/Airflow

brouberol changed the task status from Open to In Progress.Apr 30 2025, 12:44 PM

brouberol claimed this task.

brouberol moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.04.12 - 2025.05.02) board.

brouberol edited projects, added Data-Platform-SRE (2025.04.12 - 2025.05.02); removed Data-Platform-SRE.

Gehel edited projects, added Data-Platform-SRE (2025.05.02 - 2025.05.23); removed Data-Platform-SRE (2025.04.12 - 2025.05.02).May 5 2025, 12:49 PM

Gehel moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.05.02 - 2025.05.23) board.

Gehel edited projects, added Data-Platform-SRE (2025.05.24 - 2025.06.13); removed Data-Platform-SRE (2025.05.02 - 2025.05.23).May 23 2025, 1:08 PM

Gehel moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.05.24 - 2025.06.13) board.

Gehel edited projects, added Data-Platform-SRE (2025.06.13 - 2025.07.04); removed Data-Platform-SRE (2025.05.24 - 2025.06.13).Jun 13 2025, 8:49 AM

Gehel moved this task from Backlog - project to In Progress on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.

brouberol closed this task as Resolved.Jun 27 2025, 8:30 AM

brouberol moved this task from In Progress to Done on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.

Gehel moved this task from Done to Reported on the Data-Platform-SRE (2025.06.13 - 2025.07.04) board.Jun 27 2025, 2:46 PM