As an engineer,
I want to be able to run model servers from my localhost without having to build docker containers so that I can develop and debug model servers much easier.
This refactoring would be the minimal possible and would only affect package and directories structure.
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T347404 Refactor inference services repo to allow local runs | |||
| Resolved | isarantopoulos | T349371 Refactor LLM class and model server to run locally | |||
| Resolved | achou | T352181 refactor revertrisk model server to run locally |
Change 963367 had a related patch set uploaded (by Ilias Sarantopoulos; author: Ilias Sarantopoulos):
[machinelearning/liftwing/inference-services@main] revscoring: allow local runs
I have refactored revscoring model servers so that we can run them locally. I have only done this for revscoring so that we keep changes as minimal as possible and don't need to test all the model servers.
We can continue refactoring them one by one and eventually include all source code under a src dir so that the top level dir doesn't increase too much with each new model that we add to LW.
Change 963367 merged by Ilias Sarantopoulos:
[machinelearning/liftwing/inference-services@main] revscoring: allow local runs
Change 965479 had a related patch set uploaded (by Ilias Sarantopoulos; author: Ilias Sarantopoulos):
[operations/deployment-charts@master] ml-services: update revscoring
Change 965622 had a related patch set uploaded (by Ilias Sarantopoulos; author: Ilias Sarantopoulos):
[machinelearning/liftwing/inference-services@main] langid: allow local runs
Change 965479 merged by jenkins-bot:
[operations/deployment-charts@master] ml-services: update revscoring and enable articlequality mp
Change 965622 merged by jenkins-bot:
[machinelearning/liftwing/inference-services@main] langid: allow local runs
Services in inf-services repo that require refactoring to allow local runs:
This list will continue to be updated as more of the above are refactored