The first Kserve release is out: https://github.com/kserve/kserve/releases/tag/v0.7.0
I am strongly in favor of migrating to it before the release of our MVP, since we more easily upgrade at this stage.
Overall things to do:
- create new kserve docker images in the production-images repo (controller, storage-initializer, etc..)
- add a new helm chart for kserve, getting the yaml files from upstream (and apply all the custom changes that we do for kfserving)
- Upgrade inference-services' docker image to use kserve 0.7
- Deploy everything :)