Page MenuHomePhabricator

Update kserve Python package to 0.17 across all inference services
Open, Needs TriagePublic

Description

After the kserve chart upgrade in {T419722: Experiment with new kserve version on ml-staging-codfw} and following its production rollout we should update the kserve Python package to 0.17. Currently this is pinned to various versions across services (ranging from 0.11.2 to 0.16.0), with some services using unpinned or editable installs. This task tracks the upgrade to kserve 0.17 and identifies all services that require testing after the update.

Note: Using latest versions we will also be able to experiment with LLMInferenceService which is now available

Servers that are not used should be remove before updating the package.
This is the parent task aimed to track the whole process. Each of these should be tackled in separate subtasks.

  • src/models/langid/ — 0.13.1
  • src/models/readability_model/ — 0.13.1
  • src/models/article_descriptions/ — 0.13.1
  • src/models/article_country/ — 0.13.1
  • src/models/reference_quality/ — 0.13.1
  • revscoring_model/ — 0.13.1
  • src/models/logo_detection/ — 0.11.2
  • src/models/edit_check/ — 0.14.1
  • src/models/outlink_topic_model/ — 0.14.1
  • src/models/revert_risk_model/model_server/multilingual/ — 0.15.2
  • src/models/revert_risk_model/model_server/revertrisk/ — 0.15.2
  • src/models/policy_violation/ — 0.16.0 (f6f416418c33)
  • src/models/revertrisk_wikidata/ — 0.16.0
  • src/models/embeddings/ — 0.16.0
  • src/models/llm/ — 0.16.0
  • src/models/articlequality/ — editable
  • src/models/huggingface_modelserver/ — editable
  • src/models/revise_tone_task_generator/ — unpinned

Event Timeline

Change #1271480 had a related patch set uploaded (by Kevin Bazira; author: Kevin Bazira):

[machinelearning/liftwing/inference-services@main] policy-violation: upgrade model-server to use kserve v0.17

https://gerrit.wikimedia.org/r/1271480

Change #1271480 merged by jenkins-bot:

[machinelearning/liftwing/inference-services@main] policy-violation: upgrade model-server to use kserve v0.17

https://gerrit.wikimedia.org/r/1271480