Page MenuHomePhabricator
Create Task
Maniphest T425489

Migrate site to Cloud VPS?
Closed, DeclinedPublic13 Estimated Story Points
Actions

Description

This may offer more flexibility than Toolforge. See the docs. We may have to migrate to this service as ToolsDB forbids maintaining idle database connection, and the site may go against that rule.

Pros:

  • Full control of system and server.
  • Able to install own database server.
    • No longer restricted to SQLite.
    • No database connection restrictions compared to ToolsDB.
  • Able to install any software.
    • JVM, gcc/gpp, etc. if needed.

Cons:

  • Have to setup/manage OS ourselves.
  • Have to setup/manage web service ourselves.

Related Objects

Event Timeline

Danya created this task.May 5 2026, 9:47 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 5 2026, 9:47 PM
Danya set the point value for this task to 5.May 5 2026, 9:47 PM
Danya claimed this task.May 7 2026, 6:21 PM
Danya mentioned this in T425991: Investigate best solution between ToolsDB and self-hosted database.May 11 2026, 8:22 PM
Danya renamed this task from Migrate site to Wikimedia Cloud Services? to Migrate site to Cloud VPS?.May 11 2026, 8:28 PM
Danya updated the task description. (Show Details)
Danya changed the point value for this task from 5 to 6.
Danya triaged this task as High priority.May 13 2026, 7:12 PM
Danya changed the point value for this task from 6 to 7.
Danya mentioned this in T422343: Integrate Denelezh and merge stats tables.
Danya moved this task from Backlog to [deleted] on the Tool-wiki-gender-stats board.
Danya renamed this task from Migrate site to Cloud VPS? to Migrate site to Cloud VPS.May 13 2026, 7:14 PM
Danya added a parent task: T425991: Investigate best solution between ToolsDB and self-hosted database.
Danya added a parent task: T423012: Use dumps.
Danya removed a parent task: T423012: Use dumps.May 13 2026, 7:18 PM
Danya removed a parent task: T425991: Investigate best solution between ToolsDB and self-hosted database.May 14 2026, 8:38 AM
Danya added a subtask: T425991: Investigate best solution between ToolsDB and self-hosted database.
Danya added a parent task: T426264: Link to the Cloud Services End User Terms of Use.May 14 2026, 8:42 AM
Danya changed the point value for this task from 7 to 21.May 14 2026, 8:44 AM
Danya renamed this task from Migrate site to Cloud VPS to Migrate site to Cloud VPS?.May 14 2026, 8:47 AM
Danya removed a parent task: T426264: Link to the Cloud Services End User Terms of Use.May 14 2026, 12:01 PM
Danya updated the task description. (Show Details)May 14 2026, 7:12 PM
Danya added a parent task: T427430: [VERSION] 0.1.0.May 27 2026, 5:06 PM
Danya removed a parent task: T427430: [VERSION] 0.1.0.May 28 2026, 4:07 PM
Danya added a comment.May 29 2026, 7:13 PM

The JSON dump ingester is very slow on Toolforge: it took ~25h to parse 35.5 million out of ~120 million lines. Maybe we need to migrate it from Python to a faster language like Java, C, or C++. The issue is no JVM or gcc/gpp is installed on Toolforge. So having a Cloud VPS instance is probably the best way forward. Plus it would give us better control over the behavior of Flask (see T427563).

Danya updated the task description. (Show Details)May 29 2026, 7:19 PM
Danya moved this task from [deleted] to Next Version on the Tool-wiki-gender-stats board.Jun 3 2026, 5:30 PM
Danya changed the point value for this task from 21 to 13.
Danya changed the task status from Open to In Progress.Jun 3 2026, 5:37 PM
Danya moved this task from Next Version to Doing on the Tool-wiki-gender-stats board.
Danya changed the status of subtask T425991: Investigate best solution between ToolsDB and self-hosted database from Open to In Progress.
Danya added a comment.Jun 4 2026, 8:39 PM

Cloud VPS request can be found here: T428090

Danya added a parent task: T427979: [VERSION] 0.3.0.Jun 20 2026, 7:50 PM
Danya removed a subtask: T425991: Investigate best solution between ToolsDB and self-hosted database.Jun 20 2026, 7:57 PM
Danya closed this task as Declined.Jul 5 2026, 4:27 PM
Danya moved this task from Doing to Done on the Tool-wiki-gender-stats board.

After discussions in T428090, the website will stay on Toolforge. Closing this ticket.

Danya removed a parent task: T427979: [VERSION] 0.3.0.Jul 5 2026, 4:27 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits