Page MenuHomePhabricator

[TF] Only keep detailled data of latest snapshot
Closed, ResolvedPublic3 Estimated Story Points

Description

Context:

A single snapshot is about 4 GB in size. As the goal is to take monthly snapshots, the size of the database would grow too fast (~48 GB/year). This is too much data, especially since the maximum capacity of ToolsDB is 25 GB per tool.

Proposed Solution:

Keep only the detailled data for the latest snapshot and delete it for older snapshots. This will drastically reduce the total size of the database, at the cost of preventing users from making detailled queries on older snapshots. This should not pose too much of an issue as we assume that users would only care for the latest data when making work lists.

Event Timeline

Danya triaged this task as High priority.
Danya set the point value for this task to 3.
Danya moved this task from Backlog to [deleted] on the Tool-wiki-gender-stats board.
Danya changed the task status from Open to Stalled.Aug 2 2026, 4:53 PM

Finer per-wiki counts need to be computed (T433199) before erasing the old detailled data. Stalled until then.

Danya changed the task status from Stalled to In Progress.Aug 7 2026, 6:02 PM
Danya moved this task from Next Version to Doing on the Tool-wiki-gender-stats board.
Danya renamed this task from Only keep detailled data of latest snapshot to [TF] Only keep detailled data of latest snapshot.Aug 7 2026, 6:22 PM
Danya moved this task from Doing to Done on the Tool-wiki-gender-stats board.