[NFS] Automate creation of the NFS VM and the cinder volume to attach to it
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	dcaro
	Oct 19 2021, 3:31 PM

Description

This is the next iteration of https://phabricator.wikimedia.org/T291406

What

Create the <code>cloudinfra-nfs</code> project.

Define what the NFS server volume name pattern is (ex. <nfs_server_name>_share_data)

Create a cookbook that does:

Checks if a matching volume existis, if not create it
Creates a new NFS VM in the project <code>cloudinfra-nfs</code>
Link the volume to the VM
Provision the VM and if needed the volume

Details

Related Changes in Gerrit:

Subject	Repo	Branch	Lines +/-
nfs cookbooks: Better support for arbitrary prefixes and volume names	operations/cookbooks	wmcs	+6 -12
profile::wmcs::nfs::standalone: use host-prefix for the service name	operations/puppet	production	+4 -1
Added nfs/migrate_service.py	operations/cookbooks	wmcs	+341 -14
nfs/add_server: include the option to create and attach a service ip/fqdn	operations/cookbooks	wmcs	+108 -131
nfs::standalone: Don't attach network interface unless volume is attached	operations/puppet	production	+8 -5
nfs/add_server.py: one last puppet run after everthing is configured	operations/cookbooks	wmcs	+3 -0
cloudnfs: allow nfs-exportd to make public mounts actually public	operations/puppet	production	+9 -0

Customize query in gerrit

Related Objects
Search...

Status	Assigned	Task
Open	None	T272395 Cloud: reduce NAT exceptions from cloud to production
Resolved	Andrew	T291405 [NFS] Reduce or eliminate bare-metal NFS servers
Resolved	Andrew	T293800 [NFS] Automate creation of the NFS VM and the cinder volume to attach to it

Event Timeline

dcaro created this task.Oct 19 2021, 3:31 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptOct 19 2021, 3:31 PM

dcaro mentioned this in T291406: POC: puppet-provision a cinder-backed NFS server in eqiad1.Oct 19 2021, 3:31 PM

dcaro added a parent task: T291405: [NFS] Reduce or eliminate bare-metal NFS servers.Oct 19 2021, 3:34 PM

dcaro mentioned this in T293801: [NFS] Test the share migration process to an NFS VM.Oct 19 2021, 3:38 PM

Change 752805 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] All nfs-exportd to make public mounts actually public

https://gerrit.wikimedia.org/r/752805

gerritbot added a project: Patch-For-Review.Jan 11 2022, 2:41 AM

Change 752805 merged by Andrew Bogott:

[operations/puppet@production] cloudnfs: allow nfs-exportd to make public mounts actually public

https://gerrit.wikimedia.org/r/752805

Change 752810 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/cookbooks@wmcs] nfs/add_server.py: one last puppet run after everthing is configured

https://gerrit.wikimedia.org/r/752810

Change 752810 merged by jenkins-bot:

[operations/cookbooks@wmcs] nfs/add_server.py: one last puppet run after everthing is configured

https://gerrit.wikimedia.org/r/752810

Maintenance_bot removed a project: Patch-For-Review.Jan 11 2022, 4:10 AM

Change 753206 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/cookbooks@wmcs] nfs/add_server: include the option to create and attach a service ip/fqdn

https://gerrit.wikimedia.org/r/753206

gerritbot added a project: Patch-For-Review.Jan 12 2022, 5:32 AM

Change 753611 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs::standalone: Don't attach network interface unless volume is attached

https://gerrit.wikimedia.org/r/753611

Change 753611 merged by Andrew Bogott:

[operations/puppet@production] nfs::standalone: Don't attach network interface unless volume is attached

https://gerrit.wikimedia.org/r/753611

Change 753612 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/cookbooks@wmcs] Added nfs/migrate_service.py

https://gerrit.wikimedia.org/r/753612

Change 753206 merged by Andrew Bogott:

[operations/cookbooks@wmcs] nfs/add_server: include the option to create and attach a service ip/fqdn

https://gerrit.wikimedia.org/r/753206

Change 753612 merged by jenkins-bot:

[operations/cookbooks@wmcs] Added nfs/migrate_service.py

https://gerrit.wikimedia.org/r/753612

Maintenance_bot removed a project: Patch-For-Review.Jan 19 2022, 8:10 PM

Change 762951 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] profile::wmcs::nfs::standalone: use host-prefix for the service name

https://gerrit.wikimedia.org/r/762951

gerritbot added a project: Patch-For-Review.Feb 15 2022, 9:49 PM

Change 762951 merged by Andrew Bogott:

[operations/puppet@production] profile::wmcs::nfs::standalone: use host-prefix for the service name

https://gerrit.wikimedia.org/r/762951

Change 762958 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/cookbooks@wmcs] nfs cookbooks: Better support for arbitrary prefixes and volume names

https://gerrit.wikimedia.org/r/762958

Change 762958 merged by Andrew Bogott:

[operations/cookbooks@wmcs] nfs cookbooks: Better support for arbitrary prefixes and volume names

https://gerrit.wikimedia.org/r/762958

Done, documented at https://wikitech.wikimedia.org/wiki/Portal:Data_Services/Admin/Runbooks/Create_an_NFS_server

dcaro mentioned this in rCCKBf2ae68850d76: nfs/add_server.py: one last puppet run after everthing is configured.Dec 14 2022, 3:32 PM

dcaro mentioned this in rCCKB73b7e509a2b8: nfs/add_server: include the option to create and attach a service ip/fqdn.

dcaro mentioned this in rCCKB24acbe403b23: Added nfs/migrate_service.py.

dcaro mentioned this in rCCKBba9bfaf16bc2: nfs cookbooks: Better support for arbitrary prefixes and volume names.

[NFS] Automate creation of the NFS VM and the cinder volume to attach to itClosed, ResolvedPublicActions