Page MenuHomePhabricator

quarry-web-01 out of disk space
Closed, ResolvedPublic

Description

Quarry web is out of disk, looking into why.

Event Timeline

Bstorm triaged this task as High priority.May 6 2021, 5:33 PM
Bstorm created this task.
Bstorm moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.

It's being caused by /tmp filling up.

All files are owned by www-data, so this is a quarry bug.

Mentioned in SAL (#wikimedia-cloud) [2021-05-06T17:48:59Z] <bstorm> cleared out tmp files created by quarry web service that had filled the disk with find T282171

bstorm@quarry-web-01:/tmp$ df -h .
Filesystem      Size  Used Avail Use% Mounted on
/dev/vda3        19G  3.5G   15G  20% /

Now I am curious about the why here. I'll observe for a bit to see if this is leaking tmp files.

Bstorm lowered the priority of this task from High to Medium.May 6 2021, 5:53 PM

It does not seem to be currently leaking temp files. I'm not sure why the temp files filed the disk. Closing this for now.