Maniphest T354679

Add dumps mirror for data1.usrdm1.scatter.red
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	xcollazo
	Jan 9 2024, 5:44 PM

Tags

Referenced Files

None

Subscribers

Description

From mailing list:

I am changing the server I am using for mirroring dumps, discontinuing the Helsinki server effective January 19.

Host: data1.usrdm1.scatter.red
IP: 104.255.173.26
Bandwidth: 10gbps
Storage: about 24 TB
Location: Bend, Oregon, United States
Organization: Scatter

I will also start to serve dumps from the URL https://datasets.orbopengraph.com instead. I’m working on moving files over there right now so that when the first rsync is done it should be pretty quick.

Thank you,
James Hare

We need to follow guidelines from https://wikitech.wikimedia.org/wiki/Dumps/Mirror_status#Adding_a_mirror

Details

Related Changes in Gerrit:

	Subject	Repo	Branch	Lines +/-
	Update public_mirrors.html with new mirror info.	operations/puppet	production	+4 -4
	Add data1.usrdm1.scatter.red to rsync config for dumps	operations/puppet	production	+10 -0

Customize query in gerrit

Related Objects

Mentioned In: T409006: Update dump mirror rsync allowlist to reflect new IP address for Scatter

Event Timeline

xcollazo created this task.Jan 9 2024, 5:44 PM

Change 989217 had a related patch set uploaded (by Xcollazo; author: Xcollazo):

[operations/puppet@production] Add data1.usrdm1.scatter.red to rsync config for dumps

https://gerrit.wikimedia.org/r/989217

gerritbot added a project: Patch-For-Review.Jan 9 2024, 5:47 PM

xcollazo moved this task from Sprint Backlog to In Process on the Test Kitchen (Data Products Sprint 07) board.Jan 9 2024, 5:56 PM

xcollazo updated the task description. (Show Details)Jan 9 2024, 6:06 PM

Harej subscribed.Jan 9 2024, 6:10 PM

Harej awarded a token.Jan 9 2024, 6:22 PM

• WDoranWMF moved this task from In Process to Paused on the Test Kitchen (Data Products Sprint 07) board.Jan 10 2024, 5:16 PM

xcollazo moved this task from Backlog to Active on the Dumps-Generation board.Jan 12 2024, 4:38 PM

Change 989217 merged by Btullis:

[operations/puppet@production] Add data1.usrdm1.scatter.red to rsync config for dumps

https://gerrit.wikimedia.org/r/989217

Maintenance_bot removed a project: Patch-For-Review.Jan 19 2024, 3:30 PM

Edited meta wiki to reflect changes: https://meta.wikimedia.org/w/index.php?title=Mirroring_Wikimedia_project_XML_dumps&diff=prev&oldid=26095252

Change 991794 had a related patch set uploaded (by Xcollazo; author: Xcollazo):

[operations/puppet@production] Update public_mirrors.html with new mirror info as per change id: I6b720348be1600ce5a706dbacee4e0af2673139c.

https://gerrit.wikimedia.org/r/991794

gerritbot added a project: Patch-For-Review.Jan 19 2024, 3:47 PM

xcollazo moved this task from Paused to Code Review / Tech Input on the Test Kitchen (Data Products Sprint 07) board.Jan 19 2024, 3:52 PM

Confirmed with user that they can rsync successfully.

Change 991794 merged by Btullis:

[operations/puppet@production] Update public_mirrors.html with new mirror info.

https://gerrit.wikimedia.org/r/991794

xcollazo moved this task from Code Review / Tech Input to Done on the Test Kitchen (Data Products Sprint 07) board.Jan 23 2024, 2:57 PM

Maintenance_bot removed a project: Patch-For-Review.Jan 23 2024, 3:30 PM

xcollazo moved this task from Active to Done on the Dumps-Generation board.Feb 6 2024, 7:10 PM

• WDoranWMF closed this task as Resolved.Feb 20 2024, 3:49 PM

jeremyb mentioned this in T409006: Update dump mirror rsync allowlist to reflect new IP address for Scatter.Dec 8 2025, 9:16 PM