The memory footprint of our topic models is too big to safely deploy.
- Try to use gensim's memory-map mode and see if that helps
- Reduce the dimensionality of the vectors to 50 cells
- Reduce the vocab to 150k or 100k
It's important that we confirm that fitness can be maintained as we experiment so the first option -- to use memory-mapped files might be the best thing to try first.