Page MenuHomePhabricator
Create Task
Maniphest T273582

Put sdg1 on ms-be1054 back in service
Closed, ResolvedPublic
Actions

Description

This drive has been swapped for a new one in T269556, however the filesystem is not filling up again:

/dev/sdg1       3.7T   34M  3.7T   1% /srv/swift-storage/sdg1

Inspecting /var/log/rsyncd.log on the host it looks like swift object replicator attempted to rsync objects to the drive until Jan 18th (the disk broke on Dec 7th, we replaced on Jan 29th)

2021/01/18 09:30:27 [22943] rsync to object/sdg1/objects/50686 from ms-be1030.eqiad.wmnet (10.64.0.26)
2021/01/18 09:30:47 [23276] rsync to object/sdg1/objects/46135 from ms-be1030.eqiad.wmnet (10.64.0.26)
2021/01/18 09:34:20 [26161] rsync to object/sdg1/objects/46747 from ms-be1047.eqiad.wmnet (10.64.16.28)

Related Objects

Event Timeline

fgiunchedi created this task.Feb 2 2021, 8:12 AM
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptFeb 2 2021, 8:12 AM
fgiunchedi updated the task description. (Show Details)Feb 2 2021, 8:14 AM
Stashbot added a comment.Feb 2 2021, 8:30 AM

Mentioned in SAL (#wikimedia-operations) [2021-02-02T08:30:53Z] <godog> swift eqiad-prod: add weight back to sdg on ms-be1054 - T273582

fgiunchedi added a comment.Feb 2 2021, 8:32 AM

I pulled the weight on the device before the holidays, and promptly forgot about it -- putting the weight back now

fgiunchedi added a project: User-fgiunchedi.Feb 2 2021, 8:37 AM
fgiunchedi moved this task from Backlog to Doing on the User-fgiunchedi board.Feb 2 2021, 10:39 AM
fgiunchedi renamed this task from sdg1 on ms-be1054 is not rebuilding after replacement to Put sdg1 on ms-be1054 back in service.Feb 4 2021, 1:35 PM
Stashbot added a comment.Feb 15 2021, 2:08 PM

Mentioned in SAL (#wikimedia-operations) [2021-02-15T14:08:09Z] <godog> swift eqiad-prod: add weight back to sdg on ms-be1054 - T273582

fgiunchedi closed this task as Resolved.Feb 16 2021, 8:51 AM
fgiunchedi claimed this task.

Device is back at full weight

Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL