Page MenuHomePhabricator
Create Task
Maniphest T222366

Test swift object server deployment with one disk per tcp port
Closed, ResolvedPublic
Actions

Description

Next FY there will be new swift hardware coming in, it'd be a great occasion to try running one/multiple object-server per disk/port to decrease the impact of slow disks and ease contention. This setting is named servers_per_port in swift.

Details

SubjectRepoBranchLines +/-
swift: default to multiple object servers per portoperations/puppetproduction+5 -5
swift-add-machine: use per-port devicesoperations/software/swift-ringmaster+5 -2
hieradata: use servers _per_port with ms-be105[1-6]operations/puppetproduction+2 -2
codfw-prod: add ms-be2051, minimal weight and servers_per_portoperations/software/swift-ringmaster+1 K -1 K
hieradata: enable swift servers per port for new codfw hardwareoperations/puppetproduction+6 -0
swift: introduce servers_per_port for object-serveroperations/puppetproduction+5 -0
Customize query in gerrit

Related Objects

Event Timeline

fgiunchedi created this task.May 2 2019, 2:19 PM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptMay 2 2019, 2:19 PM
fgiunchedi added a subscriber: CDanis.May 2 2019, 2:19 PM
fgiunchedi added a comment.Jul 22 2019, 8:34 AM

Hardware procurement task is T227314: eqiad+codfw: 6x hardware request for swift backend (each site)

fgiunchedi added a project: User-fgiunchedi.Jul 22 2019, 8:35 AM
fgiunchedi mentioned this in T229911: Prepare swift puppetization for buster.Aug 6 2019, 10:27 AM
gerritbot added a comment.Sep 27 2019, 10:01 AM

Change 539504 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] swift: introduce servers_per_port for object-server

https://gerrit.wikimedia.org/r/539504

gerritbot added a project: Patch-For-Review.Sep 27 2019, 10:01 AM
gerritbot added a comment.Sep 27 2019, 1:01 PM

Change 539504 merged by Filippo Giunchedi:
[operations/puppet@production] swift: introduce servers_per_port for object-server

https://gerrit.wikimedia.org/r/539504

Maintenance_bot removed a project: Patch-For-Review.Sep 27 2019, 1:10 PM
fgiunchedi mentioned this in T162123: Refactor swift credentials to be global rather than per-site.Oct 1 2019, 6:33 PM
gerritbot added a comment.Oct 1 2019, 6:42 PM

Change 540196 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] hieradata: enable swift servers per port for new codfw hardware

https://gerrit.wikimedia.org/r/540196

gerritbot added a project: Patch-For-Review.Oct 1 2019, 6:42 PM
gerritbot added a comment.Oct 1 2019, 8:55 PM

Change 540196 merged by Filippo Giunchedi:
[operations/puppet@production] hieradata: enable swift servers per port for new codfw hardware

https://gerrit.wikimedia.org/r/540196

Maintenance_bot removed a project: Patch-For-Review.Oct 1 2019, 9:10 PM
gerritbot added a comment.Oct 1 2019, 9:14 PM

Change 540213 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/software/swift-ring@master] codfw-prod: add ms-be2051, minimal weight and servers_per_port

https://gerrit.wikimedia.org/r/540213

gerritbot added a project: Patch-For-Review.Oct 1 2019, 9:14 PM
gerritbot added a comment.Oct 1 2019, 9:26 PM

Change 540213 merged by Filippo Giunchedi:
[operations/software/swift-ring@master] codfw-prod: add ms-be2051, minimal weight and servers_per_port

https://gerrit.wikimedia.org/r/540213

Stashbot mentioned this in T233638: rack/setup/install ms-be205[1-6].codfw.wmnet.Oct 1 2019, 9:34 PM

Mentioned in SAL (#wikimedia-operations) [2019-10-01T21:34:40Z] <godog> swift codfw-prod: add ms-be2051 with minimal weight - T233638 T222366

Maintenance_bot removed a project: Patch-For-Review.Oct 1 2019, 10:10 PM
gerritbot added a comment.Oct 9 2019, 8:54 PM

Change 541916 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] hieradata: use servers _per_port with ms-be105[1-6]

https://gerrit.wikimedia.org/r/541916

gerritbot added a project: Patch-For-Review.Oct 9 2019, 8:54 PM
gerritbot added a comment.Oct 9 2019, 9:02 PM

Change 541916 merged by Filippo Giunchedi:
[operations/puppet@production] hieradata: use servers _per_port with ms-be105[1-6]

https://gerrit.wikimedia.org/r/541916

Maintenance_bot removed a project: Patch-For-Review.Oct 9 2019, 9:10 PM
fgiunchedi moved this task from Backlog to Doing on the User-fgiunchedi board.Oct 10 2019, 8:26 PM
gerritbot added a comment.Oct 29 2019, 2:46 PM

Change 546952 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/software/swift-ring@master] swift-add-machine: use per-port devices

https://gerrit.wikimedia.org/r/546952

gerritbot added a project: Patch-For-Review.Oct 29 2019, 2:46 PM
fgiunchedi added a comment.Oct 29 2019, 2:47 PM

Testing is successful and new hosts are running with the setting applied!

gerritbot added a comment.Oct 29 2019, 2:52 PM

Change 546956 had a related patch set uploaded (by Filippo Giunchedi; owner: Filippo Giunchedi):
[operations/puppet@production] swift: default to multiple object servers per port

https://gerrit.wikimedia.org/r/546956

gerritbot added a comment.Oct 29 2019, 2:55 PM

Change 546952 merged by CDanis:
[operations/software/swift-ring@master] swift-add-machine: use per-port devices

https://gerrit.wikimedia.org/r/546952

gerritbot added a comment.Oct 30 2019, 9:38 AM

Change 546956 merged by Filippo Giunchedi:
[operations/puppet@production] swift: default to multiple object servers per port

https://gerrit.wikimedia.org/r/546956

fgiunchedi closed this task as Resolved.Oct 30 2019, 9:40 AM
fgiunchedi claimed this task.

The default going forward is going to be multiple servers per port, existing hosts have been adapted to use the old default and I'm resolving the task

Maintenance_bot removed a project: Patch-For-Review.Oct 30 2019, 10:10 AM
fgiunchedi mentioned this in T221904: swift backend decomms / rebalances are noisy.Dec 2 2019, 12:20 PM
MatthewVernon mentioned this in T294016: Swift-recon -d overstates disk capacity and usage.Oct 21 2021, 1:25 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL · Credits