I have a machine learning webservice on the Toolforge called Wembedder. Currently it is loading a large ~500 MB model and I sometimes experience a considerable delay when the Webservice is queried. As far as I understand the Kubernetes spawn 4 process and I believe that the model might run into a problem with memory limitation.
At the same time I would like to retrain the model with new Wikidata data and enlarge the model (probably considerably). Obviously, I will run into further memory issue on the Toolforge.
I am wondering whether it would be possible to get a (virtual?) machine with larger memory. Should I request a Cloud-VPS here: https://phabricator.wikimedia.org/project/view/2875/ I see that "m1.large" is 8GB. Would it be possible to get more than that?