Page MenuHomePhabricator

Request creation of tiff compression VPS project
Closed, ResolvedPublic

Description

Project Name: tiff-compression

Developer account usernames of requestors: Ladsgroup

Purpose: This is a request for a temporary [1] VPS project to download large uncompressed tiff files, compress them and reupload them so we can save a lot of space on our storage. More details on that T427949: Uncompressed TIFFs on commons and some fun data on T427949#11979309. You can see some examples of it running currently under this: https://commons.wikimedia.org/w/index.php?title=Special:Contributions/Dexbot&target=Dexbot&dir=prev&offset=20251030113712

Brief description: The ticket should cover everything T427949: Uncompressed TIFFs on commons. The reason I need this is that these files are extremely large and it's really hard to do it on my machine reliably. Plus it gets rate limited constantly (basically after ten downloads or so). I can't use toolforge since I need to install libtiff-tools and I need a lot of memory (even my own laptop OOMs for many of them)

On what is needed: I need only one VPS but largest possible one in terms of memory (so 32GB). One floating IP would be amazing too so we can carve out an exception in rate limits.

How soon you are hoping this can be fulfilled: At your leisure.

[1] Strictly speaking, everything is temporary but I will need this for three months at most. Hopefully sooner.

Event Timeline

+1

One floating IP would be amazing too so we can carve out an exception in rate limits.

Or just carve out the rate limit for the v6 address?

Andrew claimed this task.

I created this project and boosted the RAM quota (T428169). Let me know if you can't do the rate limit exception via ipv6 and we'll get you a floating ipv4.