(An Untitled Masterwork)
ActivePublic
Actions

Authored by klausman on Nov 29 2023, 10:56 AM.

Tags

None

Referenced Files

	F41545744: raw-paste-data.txt
	Nov 29 2023, 10:56 AM

Subscribers

None

	2023-11-29 10:52:23.764 uvicorn.error ERROR: Exception in ASGI application
	Traceback (most recent call last):
	File "/opt/lib/python/site-packages/uvicorn/protocols/http/httptools_impl.py", line 419, in run_asgi
	result = await app( # type: ignore[func-returns-value]
	File "/opt/lib/python/site-packages/uvicorn/middleware/proxy_headers.py", line 78, in __call__
	return await self.app(scope, receive, send)
	File "/opt/lib/python/site-packages/fastapi/applications.py", line 276, in __call__
	await super().__call__(scope, receive, send)
	File "/opt/lib/python/site-packages/starlette/applications.py", line 122, in __call__
	await self.middleware_stack(scope, receive, send)
	File "/opt/lib/python/site-packages/starlette/middleware/errors.py", line 184, in __call__
	raise exc
	File "/opt/lib/python/site-packages/starlette/middleware/errors.py", line 162, in __call__
	await self.app(scope, receive, _send)
	File "/opt/lib/python/site-packages/timing_asgi/middleware.py", line 70, in __call__
	await self.app(scope, receive, send_wrapper)
	File "/opt/lib/python/site-packages/starlette/middleware/exceptions.py", line 79, in __call__
	raise exc
	File "/opt/lib/python/site-packages/starlette/middleware/exceptions.py", line 68, in __call__
	await self.app(scope, receive, sender)
	File "/opt/lib/python/site-packages/fastapi/middleware/asyncexitstack.py", line 21, in __call__
	raise e
	File "/opt/lib/python/site-packages/fastapi/middleware/asyncexitstack.py", line 18, in __call__
	await self.app(scope, receive, send)
	File "/opt/lib/python/site-packages/starlette/routing.py", line 718, in __call__
	await route.handle(scope, receive, send)
	File "/opt/lib/python/site-packages/starlette/routing.py", line 276, in handle
	await self.app(scope, receive, send)
	File "/opt/lib/python/site-packages/starlette/routing.py", line 66, in app
	response = await func(request)
	File "/opt/lib/python/site-packages/fastapi/routing.py", line 237, in app
	raw_response = await run_endpoint_function(
	File "/opt/lib/python/site-packages/fastapi/routing.py", line 163, in run_endpoint_function
	return await dependant.call(**values)
	File "/opt/lib/python/site-packages/kserve/protocol/rest/v1_endpoints.py", line 76, in predict
	response, response_headers = await self.dataplane.infer(model_name=model_name,
	File "/opt/lib/python/site-packages/kserve/protocol/dataplane.py", line 311, in infer
	response = await model(request, headers=headers)
	File "/opt/lib/python/site-packages/kserve/model.py", line 122, in __call__
	else self.predict(payload, headers)
	File "/srv/article-descriptions/model-server/model.py", line 90, in predict
	prediction = self.model.predict(
	File "/srv/article-descriptions/model-server/utils.py", line 141, in predict
	tokens = self.model.generate(
	File "/opt/lib/python/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
	return func(args, *kwargs)
	File "/srv/article-descriptions/model-server/descartes/src/models/descartes_mbart.py", line 570, in generate
	batch_size = inputs_tensor[list(inputs_tensor.keys())[0]].shape[0]
	AttributeError: 'NoneType' object has no attribute 'shape'

Event Timeline

klausman created this paste.Nov 29 2023, 10:56 AM

(An Untitled Masterwork)ActivePublicActions

Event Timeline

(An Untitled Masterwork)
ActivePublic
Actions