Page MenuHomePhabricator
Create Task
Maniphest T301280

Move project-specific NFS mounts onto project-local NFS servers
Closed, ResolvedPublic
Actions

Description

  • account-creation-assistance (nfs removed)
  • cvn
  • dumps
  • puppet-diffs
  • fastcci
  • huggle*
  • maps
  • math*
  • paws**
  • project-proxy (NFS removed)
  • quarry
  • testlabs
  • tools
  • twl
  • utrs* (nfs removed)
  • video*
  • wikidumpparse
  • wikilink (nfs removed)
  • wikipathways (nfs removed)
  • wmde-templates-alpha*

* confirm use case before migrating
** needs special handling due to maintain-dbusers

Details

SubjectRepoBranchLines +/-
O:wmcs::nfs: remove primary_backup::misc and related classesoperations/puppetproduction+2 -47
Remove direct NFS backup logic from cloudbackup2002operations/puppetproduction+1 -7
paws/NFS: move paws to a project-local NFS serveroperations/puppetproduction+2 -2
nfs-mounts: move video project to a project-local nfs serveroperations/puppetproduction+2 -2
nfs-mounts: fix c/p error with 'math' nfs pathoperations/puppetproduction+1 -1
nfs-mounts: move math project to a project-local nfs serveroperations/puppetproduction+1 -1
wmcs-cinder-backup-manager: add more nfs volume backupsoperations/puppetproduction+20 -2
nfs-mounts.yaml: move huggle to a project-local nfs serveroperations/puppetproduction+2 -2
nfs-mounts.yaml: move wmde-templates-alpha to a project-local nfs serveroperations/puppetproduction+1 -1
nfs-mounts.yaml: move utrs to a project-local nfs serveroperations/puppetproduction+1 -1
wmcs-cinder-backup-manager: add more nfs volume backupsoperations/puppetproduction+24 -0
nfs-mounts.yaml: move wikilink to a project-local nfs serveroperations/puppetproduction+1 -1
nfs-mounts.yaml: move wikidumpparse to a project-local nfs serveroperations/puppetproduction+2 -2
nfs-mounts.yaml: remove an unwanted . in the fastcci mount definitionoperations/puppetproduction+1 -1
nfs-mounts.yaml: move fastcci to a project-local nfs serveroperations/puppetproduction+2 -2
nfs-mounts.yaml: move twl to a project-local nfs serveroperations/puppetproduction+1 -1
wmcs-cinder-backup-manager: add two more nfs volumesoperations/puppetproduction+12 -2
nfs-mounts.yaml: fix a copy/paste error for cvn projectoperations/puppetproduction+1 -1
cinder backups: add some new nfs servers to the backup rosteroperations/puppetproduction+15 -0
nfs-mounts.yaml: move dumps to a project-local nfs serveroperations/puppetproduction+2 -2
nfs-mounts.yaml: move puppet-diffs to a project-local nfs serveroperations/puppetproduction+1 -1
nfs-mounts: move testlabs to a project-local nfs serveroperations/puppetproduction+2 -2
labstore nfs-exportd.py: Don't require public exportsoperations/puppetproduction+2 -6
profile::wmcs::nfsclient: fix hiera key name for nfs server mount pathoperations/puppetproduction+2 -2
profile::wmcs::nfsclient: allow hiera to override nfs server fqdn and pathoperations/puppetproduction+18 -6
profile::wmcs::nfs::standalone: add -nfs postfix to service domainoperations/puppetproduction+1 -1
Show related patches Customize query in gerrit

Related Objects
Search...

StatusSubtypeAssignedTask
 OpenNoneT272395 Cloud: reduce NAT exceptions from cloud to production
 ResolvedAndrewT291405 [NFS] Reduce or eliminate bare-metal NFS servers
 ResolvedAndrewT301280 Move project-specific NFS mounts onto project-local NFS servers
 ResolvedAndrewT301294 Does account-creation-assistance really need NFS?
 ResolvedAndrewT301295 Does the cloud-vps UTRS project need NFS?
 InvalidAndrewT301297 Does the cloud-vps Video project need NFS?
 ResolvedAndrewT301298 Does the cloud-vps WikiPathways project need NFS?
 DeclinedAndrewT301299 Does the cloud-vps wmde-templates-alpha project need NFS?
 ResolvedAndrewT301300 Does the 'math' project need NFS?
 DeclinedAndrewT301301 Does the cloud-vps 'huggle' project need NFS?
 ResolvedAndrewT300694 Move cloud-vps Maps nfs share to vm-hosted NFS
 DeclinedAndrewT301620 Does the 'dumps' project need NFS?
 ResolvedAndrewT301646 Does the 'wikilink' project really need NFS?
 Resolvedjsn.shermanT302401 migrate wikilink backups from nfs to cinder
 ResolvedAndrewT301715 Stop using NFS for the project-proxy cloud-vps project
 ResolveddcaroT303663 Split maintain-dbusers.py into two parts, one to run on cloudcontrol nodes and one to run on an NFS server VM
 ResolveddcaroT304040 REST api service to manage toolforge replica.my.cnf
 OpenNoneT214541 python3-ldap3 mixed versions and future traps
 ResolvedtaaviT329377 [bug] Server does not start
 Resolved• MarosteguiT330697 labsdbaccounts database grant for cloudcontrol1005
 ResolvedNoneT330916 Ensure that labstore1004.eqiad.wmnet accept http requests from cloudcontrol1005.wikimedia.org
 Resolved• MarosteguiT331014 Add GRANT access to cloudcontrol1005 for labsadmin to wikireplicas
 ResolvedrookT331056 PAWS cluster for nfs cutover
 ResolvedBUG REPORTdcaroT332762 New tool not allowed to connect to toolsdb
 InvalidBUG REPORTdcaroT332789 [maintain-dbusers] when filtering by a tool we use inconsistent filters
 ResolvedBUG REPORTdcaroT332798 [maintain-dbusers] When creating accounts, the script bails out processing other accounts if one of them fails in an unexpected way
 OpenNoneT332955 [maintain-dbusers] Generate prometheus metrics
 ResolveddcaroT332954 [maintain-dbusers] allow filtering by account type when running maintain
 ResolvedNoneT325012 Is paws-nfs-1 still used
 ResolvedAndrewT333477 Migrate tools nfs from labstore1004 server to a ceph-backed VM

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes
Andrew updated the task description. (Show Details)Feb 12 2022, 6:13 PM
gerritbot added a comment.Feb 12 2022, 6:56 PM

Change 762079 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move dumps to a project-local nfs server

https://gerrit.wikimedia.org/r/762079

gerritbot added a comment.Feb 12 2022, 7:27 PM

Change 762079 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move dumps to a project-local nfs server

https://gerrit.wikimedia.org/r/762079

Stashbot added a comment.Feb 12 2022, 7:38 PM

Mentioned in SAL (#wikimedia-cloud) [2022-02-12T19:38:33Z] <andrewbogott> rebooting most VMs to pick up new nfs server changes (T301280)

Andrew updated the task description. (Show Details)Feb 12 2022, 7:40 PM
gerritbot added a comment.Feb 12 2022, 7:42 PM

Change 762091 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] cinder backups: add some new nfs servers to the backup roster

https://gerrit.wikimedia.org/r/762091

gerritbot added a comment.Feb 12 2022, 7:44 PM

Change 762091 merged by Andrew Bogott:

[operations/puppet@production] cinder backups: add some new nfs servers to the backup roster

https://gerrit.wikimedia.org/r/762091

gerritbot added a comment.Feb 13 2022, 5:58 PM

Change 762123 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: fix a copy/paste error for cvn project

https://gerrit.wikimedia.org/r/762123

gerritbot added a comment.Feb 13 2022, 5:59 PM

Change 762123 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: fix a copy/paste error for cvn project

https://gerrit.wikimedia.org/r/762123

gerritbot added a comment.Feb 13 2022, 6:23 PM

Change 762125 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] wmcs-cinder-backup-manager: add two more nfs volumes

https://gerrit.wikimedia.org/r/762125

gerritbot added a comment.Feb 13 2022, 6:23 PM

Change 762126 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move twl to a project-local nfs server

https://gerrit.wikimedia.org/r/762126

gerritbot added a comment.Feb 13 2022, 6:24 PM

Change 762125 merged by Andrew Bogott:

[operations/puppet@production] wmcs-cinder-backup-manager: add two more nfs volumes

https://gerrit.wikimedia.org/r/762125

gerritbot added a comment.Feb 13 2022, 6:46 PM

Change 762126 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move twl to a project-local nfs server

https://gerrit.wikimedia.org/r/762126

Andrew updated the task description. (Show Details)Feb 13 2022, 6:50 PM
gerritbot added a comment.Feb 13 2022, 7:19 PM

Change 762130 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move fastcci to a project-local nfs server

https://gerrit.wikimedia.org/r/762130

gerritbot added a comment.Feb 13 2022, 7:20 PM

Change 762130 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move fastcci to a project-local nfs server

https://gerrit.wikimedia.org/r/762130

gerritbot added a comment.Feb 13 2022, 7:26 PM

Change 762131 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: remove an unwanted . in the fastcci mount definition

https://gerrit.wikimedia.org/r/762131

gerritbot added a comment.Feb 13 2022, 7:27 PM

Change 762131 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: remove an unwanted . in the fastcci mount definition

https://gerrit.wikimedia.org/r/762131

gerritbot added a comment.Feb 13 2022, 7:53 PM

Change 762133 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move wikidumpparse to a project-local nfs server

https://gerrit.wikimedia.org/r/762133

gerritbot added a comment.Feb 14 2022, 2:00 AM

Change 762133 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move wikidumpparse to a project-local nfs server

https://gerrit.wikimedia.org/r/762133

Andrew updated the task description. (Show Details)Feb 14 2022, 2:05 AM
gerritbot added a comment.Feb 14 2022, 2:10 AM

Change 762137 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move wikilink to a project-local nfs server

https://gerrit.wikimedia.org/r/762137

gerritbot added a comment.Feb 14 2022, 2:25 AM

Change 762137 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move wikilink to a project-local nfs server

https://gerrit.wikimedia.org/r/762137

Andrew updated the task description. (Show Details)Feb 14 2022, 2:28 AM
Andrew mentioned this in T301646: Does the 'wikilink' project really need NFS?.Feb 14 2022, 2:31 AM
Andrew updated the task description. (Show Details)
gerritbot added a comment.Feb 15 2022, 4:21 PM

Change 762856 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] wmcs-cinder-backup-manager: add more nfs volume backups

https://gerrit.wikimedia.org/r/762856

gerritbot added a comment.Feb 15 2022, 4:34 PM

Change 762856 merged by Andrew Bogott:

[operations/puppet@production] wmcs-cinder-backup-manager: add more nfs volume backups

https://gerrit.wikimedia.org/r/762856

Andrew updated the task description. (Show Details)Feb 15 2022, 4:40 PM
Andrew closed subtask T301715: Stop using NFS for the project-proxy cloud-vps project as Resolved.Feb 19 2022, 1:16 AM
gerritbot added a comment.Feb 19 2022, 1:44 AM

Change 763875 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move utrs to a project-local nfs server

https://gerrit.wikimedia.org/r/763875

gerritbot added a comment.Feb 19 2022, 1:44 AM

Change 763876 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move wmde-templates-alpha to a project-local nfs server

https://gerrit.wikimedia.org/r/763876

gerritbot added a comment.Feb 19 2022, 1:47 AM

Change 763875 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move utrs to a project-local nfs server

https://gerrit.wikimedia.org/r/763875

Stashbot added a comment.Feb 19 2022, 1:50 AM

Mentioned in SAL (#wikimedia-cloud) [2022-02-19T01:50:54Z] <andrewbogott> switching to a project-local nfs server for T301280

gerritbot added a comment.Feb 19 2022, 1:54 AM

Change 763878 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts.yaml: move huggle to a project-local nfs server

https://gerrit.wikimedia.org/r/763878

gerritbot added a comment.Feb 19 2022, 1:59 AM

Change 763876 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts.yaml: move wmde-templates-alpha to a project-local nfs server

https://gerrit.wikimedia.org/r/763876

Stashbot added a comment.Feb 19 2022, 2:05 AM

Mentioned in SAL (#wikimedia-cloud) [2022-02-19T02:05:18Z] <andrewbogott> switching to a project-local nfs server for T301280

Stashbot added a comment.Feb 19 2022, 2:09 AM

Mentioned in SAL (#wikimedia-cloud) [2022-02-19T02:09:28Z] <andrewbogott> rebooting VMS to switch to a project-local nfs server for T301280

Andrew updated the task description. (Show Details)Feb 19 2022, 2:14 AM
gerritbot added a comment.Feb 19 2022, 4:29 PM

Change 763909 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] wmcs-cinder-backup-manager: add more nfs volume backups

https://gerrit.wikimedia.org/r/763909

gerritbot added a comment.Feb 19 2022, 4:39 PM

Change 763909 merged by Andrew Bogott:

[operations/puppet@production] wmcs-cinder-backup-manager: add more nfs volume backups

https://gerrit.wikimedia.org/r/763909

Andrew closed subtask T301298: Does the cloud-vps WikiPathways project need NFS? as Resolved.Feb 23 2022, 2:36 AM
Andrew closed subtask T301646: Does the 'wikilink' project really need NFS? as Resolved.Feb 23 2022, 8:04 PM
Andrew closed subtask T301294: Does account-creation-assistance really need NFS? as Resolved.Feb 23 2022, 9:55 PM
Andrew updated the task description. (Show Details)
Andrew closed subtask T301301: Does the cloud-vps 'huggle' project need NFS? as Declined.Mar 31 2022, 7:50 PM
Andrew closed subtask T301299: Does the cloud-vps wmde-templates-alpha project need NFS? as Declined.
Andrew closed subtask T301295: Does the cloud-vps UTRS project need NFS? as Declined.Mar 31 2022, 7:52 PM
AmandaNP reopened subtask T301295: Does the cloud-vps UTRS project need NFS? as In Progress.Apr 18 2022, 9:58 PM
Andrew closed subtask T301620: Does the 'dumps' project need NFS? as Declined.Apr 29 2022, 7:30 PM
Andrew closed subtask T301300: Does the 'math' project need NFS? as Resolved.May 27 2022, 4:07 PM
Andrew updated the task description. (Show Details)Jun 29 2022, 1:09 PM
gerritbot added a comment.Jul 1 2022, 6:42 PM

Change 810393 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts: move math project to a project-local nfs server

https://gerrit.wikimedia.org/r/810393

gerritbot added a comment.Jul 1 2022, 7:01 PM

Change 810393 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts: move math project to a project-local nfs server

https://gerrit.wikimedia.org/r/810393

gerritbot added a comment.Jul 1 2022, 7:08 PM

Change 810395 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts: fix c/p error with 'math' nfs path

https://gerrit.wikimedia.org/r/810395

gerritbot added a comment.Jul 1 2022, 7:08 PM

Change 810395 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts: fix c/p error with 'math' nfs path

https://gerrit.wikimedia.org/r/810395

Andrew updated the task description. (Show Details)Jul 1 2022, 7:34 PM
gerritbot added a comment.Jul 1 2022, 7:44 PM

Change 810398 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] nfs-mounts: move video project to a project-local nfs server

https://gerrit.wikimedia.org/r/810398

gerritbot added a comment.Jul 1 2022, 8:25 PM

Change 810398 merged by Andrew Bogott:

[operations/puppet@production] nfs-mounts: move video project to a project-local nfs server

https://gerrit.wikimedia.org/r/810398

Andrew updated the task description. (Show Details)Jul 1 2022, 8:35 PM
Andrew closed subtask T301297: Does the cloud-vps Video project need NFS? as Invalid.Aug 18 2022, 8:28 PM
taavi closed subtask T301295: Does the cloud-vps UTRS project need NFS? as Resolved.Sep 26 2022, 6:59 AM
taavi updated the task description. (Show Details)
bd808 moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.Sep 27 2022, 9:30 PM
MoritzMuehlenhoff subscribed.Nov 29 2022, 1:45 PM
Aklapper updated the task description. (Show Details)Dec 12 2022, 2:52 PM
bd808 added a subtask: T325012: Is paws-nfs-1 still used.Dec 12 2022, 8:46 PM
bd808 mentioned this in T325006: Increase storage quota for PAWS.Dec 12 2022, 8:51 PM
rook mentioned this in T325012: Is paws-nfs-1 still used.Dec 12 2022, 8:56 PM
rook closed subtask T325012: Is paws-nfs-1 still used as Resolved.
rook subscribed.Dec 12 2022, 8:59 PM

When it is time to migrate PAWS please open a ticket, as of T321886 PAWS no longer uses the mount from the underlying host, rather mounts directly into the pods. As such the update would probably be to remove the mount to the VMs entirely and modify the mount in the helm chart to the local nfs instance.

fnegri edited projects, added cloud-services-team (FY2022/2023-Q3); removed cloud-services-team (Kanban).Jan 18 2023, 6:33 PM
taavi mentioned this in T113979: [toolforge] Allow direct ssh access to tools.Feb 15 2023, 4:36 PM
rook mentioned this in T303663: Split maintain-dbusers.py into two parts, one to run on cloudcontrol nodes and one to run on an NFS server VM.Feb 17 2023, 2:41 PM

I realize I'm probably missing something, where is maintain-dbusers.py in paws?

Andrew added a comment.Feb 17 2023, 4:42 PM
In T301280#8625152, @rook wrote:

I realize I'm probably missing something, where is maintain-dbusers.py in paws?

Right now everything is running on labstore1004 (nfs + maintain-dbusers for both paws and toolforge.) In the future part of it will still be shared on a cloudcontrol, and then paws will have a client on its NFS server and toolforge will have a client on its NFS server.

rook added a subtask: T331056: PAWS cluster for nfs cutover.Mar 2 2023, 6:51 PM
gerritbot added a comment.Mar 10 2023, 2:18 PM

Change 896353 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] paws/NFS: move paws to a project-local NFS server

https://gerrit.wikimedia.org/r/896353

gerritbot added a comment.Mar 14 2023, 1:52 PM

Change 896353 merged by Andrew Bogott:

[operations/puppet@production] paws/NFS: move paws to a project-local NFS server

https://gerrit.wikimedia.org/r/896353

rook closed subtask T331056: PAWS cluster for nfs cutover as Resolved.Mar 14 2023, 2:21 PM
Andrew updated the task description. (Show Details)Mar 27 2023, 1:48 AM
fnegri subscribed.Mar 29 2023, 4:34 PM
gerritbot added a comment.Apr 8 2023, 1:55 PM

Change 906766 had a related patch set uploaded (by Andrew Bogott; author: Andrew Bogott):

[operations/puppet@production] Remove direct NFS backup logic from cloudbackup2002

https://gerrit.wikimedia.org/r/906766

gerritbot added a comment.Apr 8 2023, 1:58 PM

Change 906766 merged by Andrew Bogott:

[operations/puppet@production] Remove direct NFS backup logic from cloudbackup2002

https://gerrit.wikimedia.org/r/906766

Andrew updated the task description. (Show Details)Apr 8 2023, 2:08 PM
gerritbot added a comment.Apr 9 2023, 8:54 AM

Change 906783 had a related patch set uploaded (by Majavah; author: Majavah):

[operations/puppet@production] O:wmcs::nfs: remove primary_backup::misc and related classes

https://gerrit.wikimedia.org/r/906783

fnegri moved this task from FY2022/2023-Q3 to FY2022/2023-Q4 on the cloud-services-team board.Apr 12 2023, 2:33 PM
fnegri edited projects, added cloud-services-team (FY2022/2023-Q4); removed cloud-services-team (FY2022/2023-Q3).
fnegri moved this task from Backlog to Planned Goals on the cloud-services-team (FY2022/2023-Q4) board.Apr 12 2023, 2:36 PM
fnegri triaged this task as High priority.Apr 12 2023, 2:45 PM
fnegri changed the status of subtask T333477: Migrate tools nfs from labstore1004 server to a ceph-backed VM from Open to In Progress.Apr 12 2023, 4:45 PM
gerritbot added a comment.Apr 18 2023, 5:09 PM

Change 906783 merged by Andrew Bogott:

[operations/puppet@production] O:wmcs::nfs: remove primary_backup::misc and related classes

https://gerrit.wikimedia.org/r/906783

fnegri added a project: Goal.Apr 19 2023, 2:26 PM
dcaro changed the status of subtask T303663: Split maintain-dbusers.py into two parts, one to run on cloudcontrol nodes and one to run on an NFS server VM from Open to In Progress.Apr 26 2023, 8:00 AM
Andrew closed this task as Resolved.May 23 2023, 1:46 PM
fnegri moved this task from Planned Goals to Done on the cloud-services-team (FY2022/2023-Q4) board.Jun 16 2023, 4:21 PM
Andrew closed subtask T333477: Migrate tools nfs from labstore1004 server to a ceph-backed VM as Resolved.Aug 7 2023, 7:22 PM
dcaro closed subtask T303663: Split maintain-dbusers.py into two parts, one to run on cloudcontrol nodes and one to run on an NFS server VM as Resolved.Aug 30 2023, 4:14 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL