Page MenuHomePhabricator

Investigate kserve 0.13.0 upgrade
Open, Needs TriagePublic3 Estimated Story Points

Description

We want to upgrade kserve to 0.13.0 but before we want to go through the changelog and investigate if there are any breaking changes that will required us to update our infrastructure (e.g. update istio).
As part of this task we will attempt to upgrade the kserve python package in huggingfaceserver which doesn't support any production traffic as well as revertrisk and document any findings.

We need to assess what is the risk (if any) of running a different version of the chart vs the python package and plan for the chart upgrade as well.

Complete list of info: https://github.com/kserve/kserve/releases/tag/v0.13.0

Related Objects

Event Timeline

Change #1041082 had a related patch set uploaded (by Ilias Sarantopoulos; author: Ilias Sarantopoulos):

[machinelearning/liftwing/inference-services@main] huggingface: kserve 0.13.0

https://gerrit.wikimedia.org/r/1041082

elukey subscribed.

Please also review T367050 :)

Change #1041082 merged by jenkins-bot:

[machinelearning/liftwing/inference-services@main] huggingface: kserve 0.13.0

https://gerrit.wikimedia.org/r/1041082

isarantopoulos set the point value for this task to 3.
isarantopoulos moved this task from Unsorted to In Progress on the Machine-Learning-Team board.

I have manually tested the new kserve version with the huggingface image and the bert model that is deployed in the experimental namespace.