SQLite may likely become too limiting once the database grows in size. We should use the already available MariaDB server from ToolsDB. It has a 25 GB limit but this should be enough for now.
There may be an issue though as the Connection handling policy forbids keeping an idle open connection. If this proves to be an issue, we may have to migrate to Cloud VPS and host our own DB instance. (See T425489)