Page MenuHomePhabricator

nova-fullstack failed on 2023-01-10
Closed, ResolvedPublic

Description

Last log entry:

Jan 10 12:20:46 cloudcontrol1005 nova-fullstack[3782261]: @cee: {"ecs.version": "1.7.0", "log.level": "ERROR", "log.origin.file.line": 119, "log.origin.file.name": "nova-fullstack", "log.origin.file.path": "/usr/local/sbin/nova-fullstack", "log.origin.function": "log_unhandled_exception", "labels": {"test_hostname": "fullstackd-20230110122031"}, "message": "Unhandled exception: Unknown Error (HTTP 503)", "process.name": "MainProcess", "process.thread.id": 3782261, "process.thread.name": "MainThread", "timestamp": "2023-01-10T12:20:46.850724", "error.stack_trace": "Traceback (most recent call last):\n  File \"/usr/local/sbin/nova-fullstack\", line 947, in <module>\n    main()\n  File \"/usr/local/sbin/nova-fullstack\", line 824, in main\n    new_vm_flavor: Flavor = nova_cli.flavors.find(name=args.flavor)\n  File \"/usr/lib/python3/dist-packages/novaclient/base.py\", line 413, in find\n    matches = self.findall(**kwargs)\n  File \"/usr/lib/python3/dist-packages/novaclient/base.py\", line 469, in findall\n    listing = self.list(**list_kwargs)\n  File \"/usr/lib/python3/dist-packages/novaclient/v2/flavors.py\", line 148, in list\n    return self._list(\"/flavors%s\" % detail, \"flavors\", filters=qparams)\n  File \"/usr/lib/python3/dist-packages/novaclient/base.py\", line 253, in _list\n    resp, body = self.api.client.get(url)\n  File \"/usr/lib/python3/dist-packages/keystoneauth1/adapter.py\", line 395, in get\n    return self.request(url, 'GET', **kwargs)\n  File \"/usr/lib/python3/dist-packages/novaclient/client.py\", line 78, in request\n    raise exceptions.from_response(resp, body, url, method)\nnovaclient.exceptions.ClientException: Unknown Error (HTTP 503)"}

Event Timeline

Mentioned in SAL (#wikimedia-cloud) [2023-01-10T12:39:17Z] <arturo> delete all VMs and restart the fullstack service on cloudcontrol1005 - T326626

aborrero triaged this task as Low priority.
aborrero moved this task from Inbox to Doing on the cloud-services-team (Kanban) board.