Page MenuHomePhabricator

Investigate the use of the shared NFS mount from labstore1003 to dataset1001
Closed, ResolvedPublic

Description

As far as I can tell, dataset1001 sends dumps data over to labstore1003 using rsync (via a cron job)

root@dataset1001:/home/madhuvishy# crontab -l
...
50 3 * * * /usr/local/sbin/labs-rsync-cron.sh labstore1003.eqiad.wmnet /data/xmldatadumps/public
...

However labstore1003 also exports /srv/dumps in RW mode to dataset1001:

From cat exports on labstore1003

/srv/dumps -rw,sec=sys,no_subtree_check,no_root_squash 208.80.154.11 208.80.152.185

And from the mounts on dataset1001

/mnt/dumps       labstore1003.eqiad.wmnet:/dumps        nfs4        rw,noatime,vers=4.0,rsize=1048576,wsize

This looks like old cruft that is not used anymore, but I'm unsure if that's really the case. @ArielGlenn, if you have any context, let us know. If it is indeed cruft, we should probably remove this export. Thanks!

Event Timeline

It hasn't been used in years: https://gerrit.wikimedia.org/r/#/c/311403/

I need to remove it from the fstab on dataset1001, which puppet didn't update, of course: done. Feel free to clean up the export on your end whenever.

Change 391824 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] labstore: rsync server on misc (dumps hosting)

https://gerrit.wikimedia.org/r/391824

Change 391824 merged by Rush:
[operations/puppet@production] labstore: rsync server on misc (dumps hosting)

https://gerrit.wikimedia.org/r/391824

Change 392063 had a related patch set uploaded (by Rush; owner: cpettet):
[operations/puppet@production] labstore: fix rsync rule for misc

https://gerrit.wikimedia.org/r/392063

@ArielGlenn This thing doesn't really look current, is it? It looks kind of done.

Yes, that last patchset is no longer needed, I believe. What is labstore1003 currently used for, do we have a list?

/srv/statistics *(ro,sec=sys,no_subtree_check,all_squash,nocrossmnt)
/srv/scratch *(rw,sec=sys,async,no_subtree_check,root_squash)
/srv/maps -rw,sec=sys,async,no_subtree_check,root_squash 10.68.16.6 10.68.17.110 10.68.16.103 10.68.16.70 10.68.20.112

It's mounted all over the place.

I suspect that scratch is the most mounted thing (that's what tools is using).

It seems that the dumps directory on there is still exported (kind of), but it's only exported via the top level directory, not directly. I could check clients to see if anything mounts that. It's exported read only. This thing has a kind of weird setup. So if someone was very devoted to mounting that dumps directory, they could. However, that does make it unlikely that one export is still in use anywhere.

Change 392063 abandoned by Rush:
labstore: fix rsync rule for misc

Reason:
this should be all obsolete with 1008/9 coming online

https://gerrit.wikimedia.org/r/392063

Bstorm claimed this task.

Any investigation of labstore1003 ends here: T187456

I've disabled NFS there, so nobody is using it now!