Page MenuHomePhabricator

Investigate best solution between ToolsDB and self-hosted database
Closed, ResolvedPublic8 Estimated Story Points

Description

SQLite may likely become too limiting once the database grows in size. We should use the already available MariaDB server from ToolsDB. It has a 25 GB limit but this should be enough for now.

There may be an issue though as the Connection handling policy forbids keeping an idle open connection. If this proves to be an issue, we may have to migrate to Cloud VPS and host our own DB instance. (See T425489)

Event Timeline

Danya triaged this task as High priority.May 11 2026, 8:14 PM
Danya set the point value for this task to 5.
Danya moved this task from Backlog to [deleted] on the Tool-wiki-gender-stats board.
Danya changed the point value for this task from 5 to 6.
Danya renamed this task from Use ToolsDB instead of SQLite to Investigate best solution between ToolsDB and self-hosted database.May 13 2026, 7:17 PM
Danya added a parent task: T423012: Use dumps.
Danya changed the point value for this task from 6 to 13.May 14 2026, 8:45 AM
Danya changed the point value for this task from 13 to 8.

Turns out 25 GB will only be enough for about ~5 months worth of data because each monthly snapshot takes up to ~5 GB. So it looks like the only option is to host our own database.

Danya changed the task status from Open to In Progress.Jun 3 2026, 5:37 PM
Danya moved this task from Next Version to Doing on the Tool-wiki-gender-stats board.

Cloud VPS request can be found here: T428090

Danya moved this task from Doing to Done on the Tool-wiki-gender-stats board.

After discussions in T428090, we will use ToolsDB as the migration to Cloud VPS was deemed unnecessary. Closing this ticket.