Due to https://github.com/distribution/distribution/pull/3982 it seems that Docker Distribution 3.x (still in the making at the time of writing, Oct 2024) removed the support for Swift (as in, completely deleted the vendored client code).
We'll likely need to move to S3/apus (T279621) to be able to upgrade in the future.