Increase Object Storage quota for QRank
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	Sascha
	Mar 14 2024, 10:47 PM

Description

Project Name: qrank
Type of quota increase requested: object storage
Amount to increase: 40 GB (no change needed to file count quota)
Reason: migrating qrank.wmcloud.org to Cloud VPS Object Storage

Background: Since ~2.5 years ago, the QRank pipeline is storing data files in S3-compatible storage. At the time, Cloud VPS did not have managed object storage, so I had set up a custom S3-compatible server which I've been running on a Cloud-VPS instance. Now that Cloud VPS offers real SRE-managed object storage, I'd like to shut down this kludge, and instead store the objects in Cloud VPS Object Storage.

Event Timeline

Sascha created this task.Mar 14 2024, 10:47 PM

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMar 14 2024, 10:47 PM

Peachey88 updated the task description. (Show Details)Mar 14 2024, 10:52 PM

• bd808 moved this task from Inbox to Approved on the Cloud-VPS (Quota-requests) board.Mar 14 2024, 11:10 PM

• bd808 moved this task from Inbox to Clinic Duty on the cloud-services-team board.

• aborrero changed the task status from Open to In Progress.Mar 15 2024, 9:41 AM

• aborrero claimed this task.

• aborrero triaged this task as Medium priority.

• aborrero added a project: User-aborrero.

• aborrero moved this task from Backlog to Doing on the User-aborrero board.Mar 15 2024, 9:49 AM

Mentioned in SAL (#wikimedia-cloud) [2024-03-15T10:35:07Z] <arturo> bump object storage quota: aborrero@cloudcontrol1005:~ $ sudo radosgw-admin quota set --quota-scope=user --uid=qrank\$qrank --max-size=40G (T360162)

Before:

aborrero@cloudcontrol1005:~ $ sudo radosgw-admin user info --uid qrank\$qrank
{
    "user_id": "qrank$qrank",
    "display_name": "qrank",
    "email": "",
    "suspended": 0,
    "max_buckets": 1000,
    "subusers": [],
    "keys": [],
    "swift_keys": [],
    "caps": [],
    "op_mask": "read, write, delete",
    "default_placement": "",
    "default_storage_class": "",
    "placement_tags": [],
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "user_quota": {
        "enabled": true,
        "check_on_raw": false,
        "max_size": 8589934592,
        "max_size_kb": 8388608,
        "max_objects": 4096
    },
    "temp_url_keys": [],
    "type": "keystone",
    "mfa_ids": []
}

After:

{
    "user_id": "qrank$qrank",
    "display_name": "qrank",
    "email": "",
    "suspended": 0,
    "max_buckets": 1000,
    "subusers": [],
    "keys": [],
    "swift_keys": [],
    "caps": [],
    "op_mask": "read, write, delete",
    "default_placement": "",
    "default_storage_class": "",
    "placement_tags": [],
    "bucket_quota": {
        "enabled": false,
        "check_on_raw": false,
        "max_size": -1,
        "max_size_kb": 0,
        "max_objects": -1
    },
    "user_quota": {
        "enabled": true,
        "check_on_raw": false,
        "max_size": 42949672960,
        "max_size_kb": 41943040,
        "max_objects": 4096
    },
    "temp_url_keys": [],
    "type": "keystone",
    "mfa_ids": []
}

Diff:

--- before	2024-03-15 10:36:35.080237543 +0000
+++ after	2024-03-15 10:36:59.820312557 +0000
@@ -22,8 +22,8 @@
     "user_quota": {
         "enabled": true,
         "check_on_raw": false,
-        "max_size": 8589934592,
-        "max_size_kb": 8388608,
+        "max_size": 42949672960,
+        "max_size_kb": 41943040,
         "max_objects": 4096
     },
     "temp_url_keys": [],

Increase Object Storage quota for QRankClosed, ResolvedPublicActions

Description

Event Timeline

Increase Object Storage quota for QRank
Closed, ResolvedPublic
Actions