Page MenuHomePhabricator

labnet/ labtestnet2001 - disk space - nova-api.log needs rotation
Closed, InvalidPublic


labtestnet2001 ran out of disk space again

reason: tiny 10G / and /var/log/upstart/nova-api.log takes a lot of that

i gzipped it before as a band-aid. needs some real logrotate and/or bigger / or disable logging

Event Timeline

Dzahn created this task.Dec 15 2016, 3:12 AM
Restricted Application added a project: Cloud-Services. · View Herald TranscriptDec 15 2016, 3:12 AM
Restricted Application added a subscriber: Aklapper. · View Herald Transcript

Mentioned in SAL (#wikimedia-operations) [2016-12-15T03:12:59Z] <mutante> labtest2001 - gzip'ed /var/log/upstart/nova-api.log (T153279)

So this file has a lot of /usr/lib/python2.7/dist-packages/nova/ DeprecationWarning: Using function/method 'oslo_utils.timeutils.strtime()' is deprecated in version '1.6' and will be removed in a future version: use either datetime.datetime.isoformat() or datetime.datetime.strftime() instead self, 'timestamp') else None, spam
Does the same occur on labnet1001?

Dzahn added a comment.Dec 15 2016, 4:47 PM

Yes, checked on labnet1001 and it also occurs there. A _lot_ of the exact deprecation warning as above. Here the log is even 13GB, it just didn't pop up earlier because / is a lot bigger (40GB instead of 10GB)

Dzahn renamed this task from labtestnet2001 - disk space - nova-api.log needs rotation to labnet/ labtestnet2001 - disk space - nova-api.log needs rotation.EditedDec 15 2016, 4:48 PM

Looks like this is where the timeutils from oslo_utils get imported:

modules/openstack/files/liberty/nova/virt-libvirt-driver:from oslo_utils import timeutils
modules/openstack/files/kilo/nova/virt-libvirt-driver:from oslo_utils import timeutils
modules/openstack/files/mitaka/nova/virt-libvirt-driver:from oslo_utils import timeutils

yeah but virt-libvirt-driver doesn't use strtime, does it? this file (nova/ would come from the nova package

GTirloni triaged this task as Medium priority.Mar 21 2019, 6:48 PM
GTirloni edited projects, added cloud-services-team (Kanban); removed Cloud-VPS.
Dzahn removed a subscriber: Dzahn.Mar 27 2019, 7:48 AM
Andrew closed this task as Invalid.Nov 27 2019, 4:23 PM
Andrew added a subscriber: Andrew.

this hasn't been an issue lately.