Maniphest T432212

Migrate to dumps-nfs.w.o in production
Open, Needs TriagePublic
Actions

Assigned To

None

Authored By

	• fgiunchedi
	Wed, Jul 15, 9:41 AM

Project Tags

Referenced Files

None

Subscribers

Description

This task tracks moving production to dumps-nfs.wikimedia.org and its /mnt/nfs/dumps mountpoint.

Unfortunately some code in production hardcodes /mnt/nfs/dumps-clouddumps1001.wikimedia.org and /mnt/nfs/dumps-clouddumps1002.wikimedia.org. Which we'll need to migrate to their canonical /mnt/data/xmldatadumps/public location instead. In production that is a symlink which points to the active clouddumps host. In the final state it will instead point to /mnt/nfs/dumps which is the dumps-nfs.wikimedia.org mount location. Upon failover umount and re-mount of said location is taken care automatically.

Hardcoded path locations

Production hosts mounting dumps-nfs as of Jul 15th 2026

an-launcher1003
stat1008
stat1009
stat1010
stat1011
wcqs2001
wdqs1024
wdqs1029
wdqs1030
wdqs1031
wdqs1032
wdqs2010

Details

Related Changes in Gerrit:

	Subject	Author	Repo	Branch	Lines +/-
	sre.wdqs.data-reload: use canonical dumps-nfs path	Filippo Giunchedi	operations/cookbooks	master	+3 -3

Customize query in gerrit

Related Changes in GitLab:

	Title	Reference	Author	Source Branch	Dest Branch
	Switch to canonical dumps filesystem paths	repos/data-engineering/airflow-dags!2412	filippo	bug/T432212	main
	Move to canonical dumps filesystem paths	repos/wikidata-platform/triplestores!6	filippo	bug/T432212	main

Customize query in GitLab

Related Objects
Search...

		Status	Subtype	Assigned	Task
		Resolved		Andrew	T375217 Complete upgrading WMCS bare metal hosts to Trixie
		Open		None	T403154 Upgrade clouddumps hosts to bookworm/trixie
		Invalid	BUG REPORT	None	T391369 If the inactive clouddumps host goes down, it causes a ripple effect on Cloud VPS and Toolforge
		Open		None	T411248 Plan to make clouddumps more resilient and easier to operate
		Open		None	T432212 Migrate to dumps-nfs.w.o in production

Event Timeline

• fgiunchedi created this task.Wed, Jul 15, 9:41 AM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptWed, Jul 15, 9:41 AM

• fgiunchedi mentioned this in T432587: Migrate to dumps-nfs.w.o in Cloud VPS.Mon, Jul 20, 10:32 AM

• fgiunchedi updated the task description. (Show Details)Mon, Jul 20, 11:30 AM

Change #1313171 had a related patch set uploaded (by Filippo Giunchedi; author: Filippo Giunchedi):

[operations/cookbooks@master] sre.wdqs.data-reload: use canonical dumps-nfs path

https://gerrit.wikimedia.org/r/1313171

gerritbot added a project: Patch-For-Review.Tue, Jul 21, 12:51 PM

Change #1313171 merged by Filippo Giunchedi:

[operations/cookbooks@master] sre.wdqs.data-reload: use canonical dumps-nfs path

https://gerrit.wikimedia.org/r/1313171

filippo opened https://gitlab.wikimedia.org/repos/wikidata-platform/triplestores/-/merge_requests/6

Move to canonical dumps filesystem paths

filippo opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/2412

Switch to canonical dumps filesystem paths

• fgiunchedi updated the task description. (Show Details)Tue, Jul 21, 2:30 PM

gmodena merged https://gitlab.wikimedia.org/repos/wikidata-platform/triplestores/-/merge_requests/6

Move to canonical dumps filesystem paths

• fgiunchedi updated the task description. (Show Details)Tue, Jul 21, 4:14 PM

dcausse merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/2412

Switch to canonical dumps filesystem paths

Maintenance_bot removed a project: Patch-For-Review.Wed, Jul 22, 10:31 AM

• fgiunchedi updated the task description. (Show Details)Wed, Jul 22, 12:22 PM