Project Name: machine-learning
Wikitech Usernames of requestors: Elukey,Klausman,Accraze,Kevin Bazira,Chris Albon
Purpose: The ML team would need a place where to build docker images and experiment with models before reaching the staging cluster in production. Running minikube would also be a plus.
Brief description: The ML team needs to be able to test the KServe stack, running the following:
- Minikube with a basic version of the stack (KServe, Knative, Istio).
- Docker to experiment with image building when testing new models, new code provided by upstream, etc..
We cannot do this in Analytics-land in production due to security concerns (one above all, running docker), but we were wondering if Cloud VPS would be a good place. We wouldn't use the VPS instances to pull random docker images from the Internet, but we'd like to build our own and test them on Minikube when experimenting. The alternative would be to use the k8s staging cluster in production that is not really viable for multiple reasons (security, flexibility, etc..).
Ideally we'd need few beefy VMs (probably 16/32G of RAM and few cores), we could start with one or two if there are capacity concerns (in theory we wouldn't need more than those in the future, a couple are more than enough).
How soon you are hoping this can be fulfilled: As soon as possible :) We are not blocked by this task, but it would be nice to have a place to experiment in this quarter.
Thanks in advance!