Project Name: hackathon-2023-ml

Wikitech Usernames of requestors: Isaac Johnson and Htriedman and then we can add others who are interested in collaborating.

Purpose: Host ML models for use at the 2023 Wikimedia Hackathon.

Brief description: As we think about what sessions / resources for the Wikimedia Hackathon, one thing we've been working on is how to make ML tools more accessible to interested tool builders. As preparation, we'd like to try to host some common types of ML models -- e.g., a chat-bot -- that folks could experiment with. This would give folks space to explore without needing to use paid APIs and also have a better sense of what's feasible on our infrastructure. We'd likely be using libraries like transformers on Python, which is Apache-licensed. We'd request at least 16GB of RAM for the project because even the smaller language models can require around 8GB or so of RAM.

How soon you are hoping this can be fulfilled: Preferably this month so we have some time ahead of the Hackathon to experiment with getting things running.