Page MenuHomePhabricator

Request creation of wikidata-deleted VPS project
Closed, ResolvedPublic

Description

Project Name: wikidata-deleted

Developer account usernames of requestors: bovlb

Purpose: Solr index of deleted items on Wikidata for use in detecting recreations

Brief description: I have been running wd-deleted.toolforge.org for several years now, and it hits a Solr instance hosted on a box under my desk, routed using DDNS. I had been hoping that my proof-of-concept would be taken on by the WMF (T297513), but it doesn't look like that's happening, so I feel it's time to move it into the cloud. It is my understanding that I cannot run Solr on ToolForge. While ElasticSearch is available on ToolForge, that would not be suitable because of the need to restrict access to deleted items. The Solr instance is not accessed directly by end users, but is accessed via the ToolForge tool.

How soon you are hoping this can be fulfilled: No rush. I am in the middle of a project to rewrite the tool as open-source, and I also have a day job. I can continue to use the Solr instance under my desk for a while.

Event Timeline

+1 I have some questions if you don't mind.

What is the resource usage you expect for it? (cpu, ram, disk, ...)

What is the resource usage you expect for it? (cpu, ram, disk, ...)

CPU: Low to moderate. The Solr query load is fairly modest, with bursts of activity for the updater.
RAM: I think 2GB is workable. I believe Solr can benefit from in-memory caching, so maybe up to 4GB.
Disk: 2GB. My solrdata volume is currently 1.5GB and holds several years of index. In moving to the new service, I plan to keep only one year, but also support multiple indexes for testing and development.
Network: Moderate traffic. Again the query results are fairly modest, but the updater will be accessing Wikidata APIs.

Mentioned in SAL (#wikimedia-cloud-feed) [2025-07-04T12:49:44Z] <taavi@cloudcumin1001> START - Cookbook wmcs.vps.create_project for project wikidata-deleted in eqiad1 (T398254)

Mentioned in SAL (#wikimedia-cloud-feed) [2025-07-04T12:51:18Z] <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.create_project (exit_code=0) for project wikidata-deleted in eqiad1 (T398254)

This project has been created. @Bovlb: please make sure that you are subscribed to the cloud-announce mailing list.