Page MenuHomePhabricator
Paste P58780

(An Untitled Masterwork)
ActivePublic

Authored by isarantopoulos on Mar 13 2024, 5:05 PM.
Tags
None
Referenced Files
F42600975: raw-paste-data.txt
Mar 13 2024, 5:05 PM
Subscribers
None
```
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/srv/app/huggingfaceserver/__main__.py", line 74, in <module>
kserve.ModelServer(registered_models=HuggingfaceModelRepository(args.model_dir)).start(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/srv/app/huggingfaceserver/huggingface_model_repository.py", line 24, in __init__
self.load_models()
File "/opt/lib/python/site-packages/kserve/model_repository.py", line 40, in load_models
self.load_model(name)
File "/srv/app/huggingfaceserver/huggingface_model_repository.py", line 30, in load_model
model = HuggingfaceModel(name, os.path.join(self.models_dir, name))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/srv/app/huggingfaceserver/model.py", line 62, in __init__
self.model_id = kwargs.get('model_id', None)
^^^^^^^^^^
```
```
INFO:kserve:successfully loaded huggingface model from path /mnt/models
Traceback (most recent call last):
File "<frozen runpy>", line 198, in _run_module_as_main
File "<frozen runpy>", line 88, in _run_code
File "/srv/app/huggingfaceserver/__main__.py", line 74, in <module>
kserve.ModelServer(registered_models=HuggingfaceModelRepository(args.model_dir)).start(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/srv/app/huggingfaceserver/huggingface_model_repository.py", line 24, in __init__
self.load_models()
File "/opt/lib/python/site-packages/kserve/model_repository.py", line 38, in load_models
d = os.path.join(self.models_dir, name)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "<frozen posixpath>", line 76, in join
TypeError: expected str, bytes or os.PathLike object, not NoneType
```