Got an email about puppet failing on one of the canary vms, checeked the project and there's a bunch of instances, looking
I was mistaking these canaries with the nova-fullstack tests, these are not leftovers but meant to be up continuously:
Checking why puppet failed on this one.
It seems to be out of memory and puppet crashes before finishing the run:
dcaro@canary1022-01:~$ free -m total used free shared buff/cache available Mem: 481 348 18 5 115 115 Swap: 0 0 0
There's a process called 'diamond' running that takes most of the memory, will restart the machine but if it happens
again might be worth taking a closer look.