Page MenuHomePhabricator

Migrate from Kfserving to Kserve
Open, Needs TriagePublic

Description

The first Kserve release is out: https://github.com/kserve/kserve/releases/tag/v0.7.0

I am strongly in favor of migrating to it before the release of our MVP, since we more easily upgrade at this stage.

Overall things to do:

  1. create new kserve docker images in the production-images repo (controller, storage-initializer, etc..)
  2. add a new helm chart for kserve, getting the yaml files from upstream (and apply all the custom changes that we do for kfserving)
  3. Upgrade inference-services' docker image to use kserve 0.7
  4. Deploy everything :)

Related Objects

StatusSubtypeAssignedTask
OpenNone
OpenNone

Event Timeline

Change 730722 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/docker-images/production-images@master] Add the KServe images

https://gerrit.wikimedia.org/r/730722

Change 730761 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/deployment-charts@master] Add the kserve and kserve-inference charts

https://gerrit.wikimedia.org/r/730761

Change 730762 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/deployment-charts@master] Move the ml-serve cluster to KServe

https://gerrit.wikimedia.org/r/730762

Change 730722 merged by Elukey:

[operations/docker-images/production-images@master] Add the KServe images

https://gerrit.wikimedia.org/r/730722

Change 730761 merged by Elukey:

[operations/deployment-charts@master] Add the kserve and kserve-inference charts

https://gerrit.wikimedia.org/r/730761

Change 730762 merged by Elukey:

[operations/deployment-charts@master] Move the ml-serve cluster to KServe

https://gerrit.wikimedia.org/r/730762

Change 730807 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/deployment-charts@master] helmfile.d: update the deploy-kserve cluster role to KServe

https://gerrit.wikimedia.org/r/730807

Change 730807 merged by Elukey:

[operations/deployment-charts@master] helmfile.d: update the deploy-kserve cluster role to KServe

https://gerrit.wikimedia.org/r/730807

Change 730831 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/deployment-charts@master] Remove any trace of Kubeflow Kfserving

https://gerrit.wikimedia.org/r/730831

Change 730832 had a related patch set uploaded (by Elukey; author: Elukey):

[operations/docker-images/production-images@master] Remove Kubeflow Kfserving

https://gerrit.wikimedia.org/r/730832

Change 730832 merged by Elukey:

[operations/docker-images/production-images@master] Remove Kubeflow Kfserving

https://gerrit.wikimedia.org/r/730832

Change 730831 merged by Elukey:

[operations/deployment-charts@master] Remove any trace of Kubeflow Kfserving

https://gerrit.wikimedia.org/r/730831