Page MenuHomePhabricator

Completely remove Beta Cluster dependency on NFS
Closed, ResolvedPublic

Description

In an effort to bring deployment-prep back up while the NFS cluster was completely down, we've disabled NFS from it completely. That broke some things, which is good. We are now removing our dependency on NFS.

Please add blockers to this task.

Related Objects

Event Timeline

yuvipanda raised the priority of this task from to Needs Triage.
yuvipanda updated the task description. (Show Details)
yuvipanda added a subscriber: yuvipanda.

Uploads/thumbnails seem broken (some stuff still seems to be around, but probably due to cache? I think it would all be from NFS, so...)

Logstash-beta is broken, HTTP 500 ISE due to:

[Thu Jun 18 14:53:57 2015] [error] [client 10.68.16.65] (2)No such file or directory: Could not open password file: /data/project/logstash/.htpasswd, referer: https://logstash-beta.wmflabs.org/

@Krenair please fill subtasks as needed. This is a tracking bug :-}

Logstash filled as T102962
UploadWizard as T102963

UploadWizard as T102963

Just turned that into a generic upload issues task.

hashar claimed this task.

Seems all NFS related breakages have been fixed now.

By NFS being up, sure... Shouldn't we be trying to make it not depend on NFS?

This is not resolved unless nothing in beta is expected to break next time NFS does.

Thanks @Krenair.

Well NFS is gone from the deployment-prep. Its only use now are the upload/thumbnails. We need to migrate to swift which is T64835 blocking T84950: Thumbnail generation should happen via the same setup in the beta cluster and in production (tracking).

hashar moved this task from To Triage to Backlog on the Beta-Cluster-Infrastructure board.
greg renamed this task from Things broken by betacluster suddenly being moved off NFS to Completely remove Beta Cluster dependency on NFS.Jun 24 2015, 10:25 PM
greg updated the task description. (Show Details)

Given that the only place NFS is mounted in deployment-prep is deployment-upload, which is shutoff and to be deleted at some point, I think we can call this done.

Change 299123 had a related patch set uploaded (by Yuvipanda):
labs: Remove nfs for deployment-prep \o/

https://gerrit.wikimedia.org/r/299123

Change 299123 merged by Yuvipanda:
labs: Remove nfs for deployment-prep \o/

https://gerrit.wikimedia.org/r/299123