May 16 08:17:52 clouddumps1001 puppet-agent[2604897]: (/Stage[main]/Profile::Dumps::Distribution::Server/File[/srv/dumps/xmldatadumps_airflow_temp/xmldatadumps/pu>
@BTullis said on Slack:
It's related to the way that the cephfs volume is mounted with the sticky bit set. I didn't decide what needs to change. I first tried a chmod on the source volume, but it didn't stick. So I think I'll change the rsync parameters to ignore perms.
| Title | Reference | Author | Source Branch | Dest Branch | |
|---|---|---|---|---|---|
| dumps: Update the parallel-rsync extra args for the sync monitor | repos/data-engineering/airflow-dags!1360 | btullis | dumps_prsync_args | main | |
| dumps: Stop syncing perms with parallel-rsync | repos/data-engineering/airflow-dags!1342 | btullis | dumps_update_sync_perms | main |
btullis opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1342
dumps: Stop syncing perms with parallel-rsync
I'm reopening this, as I didn't actually apply a fix yet.
The Airflow DAG that alters the permissions on /srv/dumps/xmldatadumps_airflow_temp was not working for a different reason, which is why puppet stopped constantly changing the permissions back.
I'm just testing the fix now.
btullis merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1342
dumps: Stop syncing perms with parallel-rsync
btullis opened https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1360
dumps: Update the parallel-rsync extra args for the sync monitor
btullis merged https://gitlab.wikimedia.org/repos/data-engineering/airflow-dags/-/merge_requests/1360
dumps: Update the parallel-rsync extra args for the sync monitor