Page MenuHomePhabricator

Use encrypted rsync for deployment::rsync
Closed, ResolvedPublic

Description

While auditing codfw/eqiad traffic during switchover (T286038) I came across plaintext rsync for deploy hosts, please consider switching to encrypted rsync

Event Timeline

@fgiunchedi do you have any pointers on what switching to encrypted rsync entails? Is it just a puppet setting somewhere?

Essentially a puppet setting yes, rsync::server::wrap_with_stunnel for the server bits and then e.g. rsync::quickdatacopy has the option to turn on ssl on the client too. See e.g. grafana and netmon use encrypted rsync

fgiunchedi triaged this task as Medium priority.Aug 30 2021, 7:50 AM

Change 715638 had a related patch set uploaded (by Legoktm; author: Legoktm):

[operations/puppet@production] [WIP] deployment: Use rsync::quickdatacopy, enable encryption

https://gerrit.wikimedia.org/r/715638

I'm guessing no one has done this until now because deployment::rsync was using hand-rolled rsync + timer rather than quickdatacopy. I gave it a shot at migrating to that, which seemed better long-term than copying all the stunnel encryption stuff.

Mentioned in SAL (#wikimedia-operations) [2023-06-28T10:51:31Z] <claime> Migrating to rsync::quickdatacopy for deployment servers - T289857

Change 715638 merged by Clément Goubert:

[operations/puppet@production] deployment: Use rsync::quickdatacopy, enable encryption

https://gerrit.wikimedia.org/r/715638

Mentioned in SAL (#wikimedia-operations) [2023-06-28T11:08:00Z] <claime> Reverting migration to rsync::quickdatacopy for deployment servers - T289857

Reverted because rsync::quickdatacopy wants fqdns, we're giving it IPs, nothing gets deployed.
I will prepare a fix and we can try again.

Clement_Goubert changed the task status from Open to In Progress.Jun 28 2023, 11:42 AM
Clement_Goubert claimed this task.

Change 933911 had a related patch set uploaded (by Clément Goubert; author: Legoktm):

[operations/puppet@production] deployment: Use rsync::quickdatacopy, enable encryption

https://gerrit.wikimedia.org/r/933911

Change 933911 merged by Clément Goubert:

[operations/puppet@production] deployment: Use rsync::quickdatacopy, enable encryption

https://gerrit.wikimedia.org/r/933911

Mentioned in SAL (#wikimedia-operations) [2023-07-04T14:53:55Z] <claime> Deploying encrypted rsync to deployment servers - T289857

Deployed, data transfer works between deploy2002 and deploy1002.
Resolving.