Page MenuHomePhabricator

Replace NFS in wikidumpparse with a standard cinder volume
Open, Needs TriagePublic

Description

While working on T429793, I'm noting that the wikidumpparse project has only two instances: one nfs server (wikidumpparse-nfs-1) and one other host that mounts that nfs servers.

NFS is typically not useful when only used on one host! Can we just remove that nfs server and copy the files onto a static cinder volume? That would make life a lot easier in the future.

Event Timeline

Restricted Application added a subscriber: Aklapper. · View Herald Transcript
Andrew renamed this task from Can we stop using NFS in wikidumpparse? to Replace NFS in wikidumpparse with a standard cinder volume.Jun 26 2026, 1:46 PM

Here are the two nfs mounts we will be replacing:

wikidumpparse-nfs.svc.wikidumpparse.eqiad1.wikimedia.cloud:/srv/wikidumpparse/project	/mnt/nfs/labstore-secondary-project	
wikidumpparse-nfs.svc.wikidumpparse.eqiad1.wikimedia.cloud:/srv/wikidumpparse/home	/mnt/nfs/labstore-secondary-home

Steps:

  • create new cinder volume, mount on wikidumpparse-nfs-1 as /srv/nfscopy
  • rsync nfs to new volume: /srv/nfscopy/
  • stop running services on humaniki-prod-bw to prevent race conditions <- which services write to nfs?
  • unmount nfs from humaniki-prod-bw, remove nfs entries from fstab
  • adjust puppet settings to prevent nfs re-mount from humaniki-prod-bw (project hiera "mount_nfs: false")
  • one last rsync (again, to avoid races.) Run on wikidumpparse-nfs-1: "rsync -a /srv/wikidumpparse/* /srv/nfscopy/"
  • detach cinder volume from wikidumpparse-nfs-1, attach to humaniki-prod-bw, mount as /srv/humanikivolume and add to fstab
  • symlink /mnt/nfs/labstore-secondary-project to /srv/humanikivolume/project
  • symlink /mnt/nfs/labstore-secondary-home to /srv/humanikivolume/home
  • change /home link to /srv/humanikivolume/home
  • reboot, confirm $home is working properly

Now the only thing that's a bit messed up is that you have references to /mnt/nfs/labstore-secondary-project which is just a symlink and not really an nfs mount; ideally you would update those to point directly to /srv/humanikivolume/project.

You also have remnants of the previous regime which can be deleted once you're convinced things are good:

  • wikidumpparse-nfs-1 instance
  • wikidumpparse-nfs volume