User Details
- User Since
- Feb 27 2015, 10:47 PM (479 w, 5 d)
- Availability
- Available
- IRC Nick
- urandom
- LDAP User
- Eevans
- MediaWiki User
- EEvans (WMF) [ Global Accounts ]
Yesterday
Tue, May 7
Ok @Jgiannelos this should now be setup:
Thu, May 2
The final changeset —r1026194— is up, but will need to pass review by Infrastructure Foundations (reviewed weekly, on Mondays).
Hi @jsn.sherman, You've been added to the deployment group, your shell username is jsn (same as wmf cloud). Let me know if you have any issues!
Tue, Apr 30
The rebuild is complete:
@thcipriani It looks like you're the approver for group deployment... do you?
@jsn.sherman Could you please do one of the following? Either:
Mon, Apr 29
Ok, sdf has been replaced again, here is a transcript of what was done to add it back to the array:
Ok, so to summarize what has happened so far:
Sat, Apr 27
Restarted via the drac and everything seems OK now. I skimmed the logs and didn't see anything that seemed unusual prior to the event.
Also unable to login via the serial console.
Fri, Apr 26
The first device is done rebuilding:
Thu, Apr 25
Ok, the rebuild is complete.
Wed, Apr 24
2:23 PM <jclark-ctr> i am swapping sdf again
2:24 PM <jclark-ctr> swapped with one that was just erased
Having some trouble adding sdf2 back into the array: mdadm: Cannot open /dev/sdf2: Device or resource busy :/
Tue, Apr 23
Here is a transcript of everything done (for posterity sake):
Hey @Jclark-ctr: I hope it's OK to assign this one to you as well.
Fri, Apr 19
Thu, Apr 18
Wed, Apr 17
Tue, Apr 16
We've made the upgrade to 4.x already, and we did so without a migration. If I've understood the context above, that was the reason for elevating the priority, so I'm going to drop it down now. Please fee free to readjust if that's wrong.
We've encountered a problem enabling verification for gocql-based clients (see: T352647#9715110). We'll need to implement a custom HostDialer for Cassandra-connecting golang services before this work can continue.
Mon, Apr 15
{"msg":"error: failed to connect to \"[HostInfo hostname=\\\"10.192.48.54\\\" connectAddress=\\\"10.192.48.54\\\" peer=\\\"10.192.48.54\\\" rpc_address=\\\"10.192.48.54\\\" broadcast_address=\\\"\u003cnil\u003e\\\" preferred_ip=\\\"\u003cnil\u003e\\\" connect_addr=\\\"10.192.48.54\\\" connect_addr_source=\\\"connect_address\\\" port=9042 data_centre=\\\"codfw\\\" rack=\\\"A_D\\\" host_id=\\\"5bfa3453-48f8-4c3c-82ea-478c460b6ee5\\\" version=\\\"v4.1.1\\\" state=UP num_tokens=256]\" due to error: x509: cannot validate certificate for 10.192.48.54 because it doesn't contain any IP SANs","appname":"sessionstore","time":"2024-04-15T18:25:35Z","level":"WARNING"}
Thu, Apr 11
Wed, Apr 10
Apr 8 2024
Apr 5 2024
The original scope of this ticket was a very specific request to retrieve data, and that request as been met, so I'll close this ticket now.