Page MenuHomePhabricator

user `marcmiquel` gzipping 41G file on NFS
Closed, ResolvedPublic

Description

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
16222 marcmiq+  20   0   12024   6176    504 R  90.3  0.1  46:17.98 bzip2
root@tools-bastion-01:/home/marcmiquel/data_folder# ls -l /proc/16222/fd
total 0
lrwx------ 1 marcmiquel wikidev 64 Jan 27 11:09 0 -> /dev/pts/41
lrwx------ 1 marcmiquel wikidev 64 Jan 27 11:09 1 -> /dev/pts/41
lrwx------ 1 marcmiquel wikidev 64 Jan 27 11:09 2 -> /dev/pts/41
lr-x------ 1 marcmiquel wikidev 64 Jan 27 11:09 3 -> /home/marcmiquel/data_folder/session_revisions.enwiki.2015-08.tsv.bz2
l-wx------ 1 marcmiquel wikidev 64 Jan 27 11:09 4 -> /home/marcmiquel/data_folder/session_revisions.enwiki.2015-08.tsv
root@tools-bastion-01:/home/marcmiquel/data_folder# ls -lh /home/marcmiquel/data_folder/session_revisions.enwiki.2015-08.tsv*
-rw------- 1 marcmiquel wikidev 42G Jan 27 11:11 /home/marcmiquel/data_folder/session_revisions.enwiki.2015-08.tsv
-rw-r--r-- 1 marcmiquel wikidev 27G Oct 13 14:24 /home/marcmiquel/data_folder/session_revisions.enwiki.2015-08.tsv.bz2

This is overloading NFS on tools-bastion (~40MB/s read/write); I have suspended the process.

Related Objects

Event Timeline

valhallasw updated the task description. (Show Details)
valhallasw raised the priority of this task from to Needs Triage.
valhallasw added a project: Toolforge.
valhallasw added subscribers: valhallasw, marcmiquel.
Restricted Application added a project: Cloud-Services. · View Herald TranscriptJan 27 2016, 11:12 AM
Restricted Application added subscribers: StudiesWorld, Aklapper. · View Herald Transcript
chasemp closed this task as Resolved.Mar 2 2016, 11:35 PM
chasemp added a subscriber: chasemp.

thanks @valhallasw. for posterity we have spoken with marcmiquel a few times and he recognizes the issue. There is some mitigation in place to prevent this from messing up NFS globally, and I have asked him to use the -dev bastion host. We could also spin up an isolated VM for this if necessary, but I haven't seen him online in awhile.