Scope
We would like to build an API in inference-services repository which exposes the openapi-specs (yaml files) for each one of the LiftWing models. This way we can configure the RestSandbox and make these v1 endpoints available for testing via the swagger-ui (using the "TryOut" option in the UI).
Due to limitations of the out-of-the-box Kserve specs (more info in this comment), we need to expose them in a more custom way.
This API will not be a classic Kserve model-server similar to our other models we need to understand how this can be deployed as a service.
Requirements
- LiftWing API exposing the /docs
- Deployment
- Endpoint url
Please feel free to add more information if you find something unclear or if there are any missing parts.