Page MenuHomePhabricator
Create Task
Maniphest T284966

cluebotng using high storage on NFS
Closed, ResolvedPublic
Actions

Description

cluebotng is taking up a lot of space with mysql backups again, it seems.
61G mysql_backups
I also truncated a 10GB error.log file that had contents like:

2021-06-14 22:17:11: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   1. {main}() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/index.php:0
2021-06-14 22:17:11: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   2. require_once() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/index.php:2
2021-06-14 22:17:11: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   3. require_once() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/includes/header.php:7
2021-06-14 22:17:11: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   4. file_get_contents() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/web-settings.php:6
2021-06-14 22:17:40: (mod_fastcgi.c.2543) FastCGI-stderr: PHP Warning:  file_get_contents(/data/project/cluebot/.current_relay_node): failed to open stream: No such file or directory in /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/web-settings.php on line 6
2021-06-14 22:17:40: (mod_fastcgi.c.2543) FastCGI-stderr: PHP Stack trace:
2021-06-14 22:17:40: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   1. {main}() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/index.php:0
2021-06-14 22:17:40: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   2. require_once() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/index.php:2
2021-06-14 22:17:40: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   3. require_once() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/includes/header.php:7
2021-06-14 22:17:40: (mod_fastcgi.c.2543) FastCGI-stderr: PHP   4. file_get_contents() /mnt/nfs/labstore-secondary-tools-project/cluebotng/apps/report_interface/web-settings.php:6

Related Objects
Search...

Event Timeline

Bstorm created this task.Jun 15 2021, 12:16 AM
Bstorm added a parent task: T284964: 2021-06-15: Tools NFS share cleanup.
RhinosF1 added a subscriber: RhinosF1.Jun 15 2021, 10:21 PM
Bstorm edited parent tasks, added: T288276: 2021-08-05: Tools NFS share cleanup; removed: T284964: 2021-06-15: Tools NFS share cleanup.Aug 5 2021, 5:59 PM
Legoktm added subscribers: DamianZaremba, Legoktm.Oct 30 2021, 12:41 AM

@RichSmith, @DamianZaremba, @Cobi could one of you take a look at this? Toolforge is getting close to its NFS limit again.

DamianZaremba added a comment.Oct 30 2021, 6:12 AM

I will have a look later, but I suspect this is due to a stuck task which has seemingly also been affecting restarts in the last weeks; unless the schema grew drastically in the last months. These dumps are primarily used for development and ad-hoc copies of the history for archival, so the current 1 week retention can be reduced if required.

The error log should already have been fixed, the api functionally was removed in v1.0.4 as it hasn't work for a long time.

DamianZaremba closed this task as Resolved.Nov 1 2021, 9:33 PM
tools.cluebotng@tools-sgebastion-07:~$ du -shc .
8.1G	.
8.1G	total
Legoktm added a comment.Nov 1 2021, 9:50 PM

Thank you!

Content licensed under Creative Commons Attribution-ShareAlike 3.0 (CC-BY-SA) unless otherwise noted; code licensed under GNU General Public License (GPL) or other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL