One of our biggest and most legit users, stake out alternative possible solutions.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | yuvipanda | T105720 Labs team reliability goal for Q1 2015/16 | |||
| Resolved | Andrew | T102240 Audit projects' use of NFS, and remove it where not necessary | |||
| Open | None | T102402 Find alternative solutions for video project's use of NFS |
Event Timeline
Comment Actions
My main usage of Disk space is Temp storage for videos while transcoding. I remove them after the upload to commons is done.
The second use case is local tooling and typical users home directory stuff such as pywikibot clone, local scripts, working dir files etc.
Here is the life cycle of an upload of a video:
- download from video site - requires storage
- transcode - requires storage
- upload to commons
- delete
Comment Actions
I will move to be using /data/scratch for the main video transcoding. other activities will remain within my home dir.
Comment Actions
@Matanya can I kill everything except /data/scratch then? Do you still want the ~2T of data in /data/project?
Comment Actions
I still need that data. until i figure out how to upload those files given commons limitation.
Comment Actions
It's been a LONG time since this got any attention; @Matanya can you advise about what can be done with the NFS mounts?
Comment Actions
@Matanya: Could you please answer the last comment, if you have some time? Thanks a lot in advance!