Do we use affinity features with a global cluster or stick with swiftrepl? The later is too slow to be real-time...I guess SyncFileBackend could be used to (with a --locking flag added).
Current solution planned is:
a) Use multiwrite backend to both DCs (eqiad sync, codfw post-send and async)
b) Use local read affinity
c) Run swift-repl to repair any lost writes in the background (due to failures)
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Resolved | aaron | T88445 MediaWiki active/active datacenter investigation and work (tracking) | |||
| Resolved | aaron | T91869 Implement a replication strategy for Swift | |||
| Resolved | fgiunchedi | T119651 Set $wmfSwiftCodfwConfig in PrivateSettings | |||
| Resolved | aaron | T125791 swiftrepl replication pass for thumbnails eqiad -> codfw |
no affinity features at the moment, we run swiftrepl in an ad-hoc fashion, I looked into container replication and setup an initial trial but got stuck with some containers not replicating and never had a chance to look into why
on the context of swift and multi region and what that entails, see also https://bugs.launchpad.net/swift/+bug/1462527
Change 266609 had a related patch set uploaded (by Aaron Schulz):
Enable deferred writes to codfw swift cluster
Change 272611 had a related patch set uploaded (by Filippo Giunchedi):
Enable async secondary swift writes for non-"big" wikis
Change 272611 merged by jenkins-bot:
Enable async secondary swift writes for non-"big" wikis
Change 273561 had a related patch set uploaded (by Aaron Schulz):
Allow FSFile objects for src in FileBackend::do*Operations
tentative schedule to enable async replication on the remaining wikis (modulo resolution/writeup of https://phabricator.wikimedia.org/T128096)
Change 268080 had a related patch set uploaded (by Filippo Giunchedi):
swift: switch to codfw imagescalers
Change 273561 merged by jenkins-bot:
Allow FSFile objects for src in FileBackend::do*Operations
Change 274796 had a related patch set uploaded (by Aaron Schulz):
[WIP] Make UploadBase use TempFSFile to wrap the temporary file
Change 274796 merged by jenkins-bot:
Make UploadBase use TempFSFile to wrap the temporary file