Page MenuHomePhabricator

Object store?
Open, Needs TriagePublic

Description

For a few tools, I find it necessary/helpful to store large numbers of medium-sized blobs (scraped HTML pages, JSON text, the like). I am currently using MariaDB tables for this, but some have grown to significant size, and I had to truncate one table recently, after a warning about the database size.

Is there/could there be an object store available on Toolforge/Labs, so that I can just record the Object URI/ID/whatnot in the database, and store the blob in the object store?

Not urgent or breaking, but might be nice to have...

Related Objects

Event Timeline

Magnus created this task.Jun 6 2019, 10:17 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJun 6 2019, 10:17 AM
bd808 added a subscriber: bd808.Jun 16 2019, 5:05 PM

A major focus for the cloud-services-team in the July 2019-June 2020 fiscal year will be improving and enhancing the storage systems that we use both "in the backend" for managing Cloud VPS instance virtual disks and in the more visible areas such as our current NFS system. The backend project will be worked on first, but we hope that work will lead to us being able to provide other features like an S3-like bucket+object storage interface in the later stages of the project. We are not ready to make any timeline commitments yet for when this might be available in Toolforge and other Cloud VPS projects.

bd808 moved this task from Triage to Feature requests on the Toolforge board.Jun 16 2019, 5:06 PM