User Details
- User Since
- Aug 14 2018, 10:50 AM (291 w, 6 d)
- Availability
- Available
- IRC Nick
- effie
- LDAP User
- Effie Mouzeli
- MediaWiki User
- EMouzeli (WMF) [ Global Accounts ]
Wed, Mar 6
Tue, Mar 5
mw-mcrouter ds has been deployed on staging mw-mcrouter staging
Mon, Mar 4
Looks alright!
@Trizek-WMF as per our off-phabricator discussion, the major change is that this is not a procedure we test anymore, but it has become standard practice. Please edit the message as you see fit to reflect that.
Thu, Feb 29
Tue, Feb 27
Looking into the issue, we found that around 26th Feb @ ~21:45 UTC, the urldownloader1003 (ganeti VM running on ganeti1027 ie cluster master) lost network connectivity
This was most likely related to T358597
After issuing a restart, the VM came back to life normally.
Fri, Feb 23
Thu, Feb 22
Wed, Feb 21
Feb 14 2024
Things are progressing well after the last change, please reopen if this resurfaces. Shoutout to @akosiaris for lending a hand
Feb 13 2024
- tcpdump shows that upstream sends an RST, but nothing else useful
Feb 12 2024
so far:
Feb 8 2024
I set the host as inactive since I noticed a bit of log spam on lvs2013
Feb 7 2024
I can see in the appserver logs
Feb 6 2024
We'll take a look and get back to you
Feb 1 2024
Stalled until T356412 is picked up by Data-Persistence
Jan 31 2024
Jan 29 2024
Jan 17 2024
Jan 11 2024
We merged a fix to unblock this, your are good to go.
Jan 10 2024
We are working on updating the underline template which is causing the errors you are seeing, I will let you know when it is properly fixed. Sorry for the inconvenience!
Jan 9 2024
Dec 15 2023
Prep work for memcached hosts is in place; those hosts are using each host's puppet certs for TLS, and migrating to puppet7 needs a minor tweak due to the puppet 7 ca cert not being present on puppet 5 hosts. Hosts will be migrated to puppet 7 in January.
Started putting together a debian package on https://gitlab.wikimedia.org/repos/sre/prometheus-memcached-exporter
Dec 11 2023
done:)
@Mcastro done, please reopen if something is not right
Dec 8 2023
User is present in archiva-deployers LDAP group, please reopen if there is anything else
Dec 7 2023
@ehughes please sign the L3 Acknowledgement of Wikimedia Server Access Responsibilities Document so we can proceed
Are there any actionables here for serviceops ?
Dec 6 2023
boldly closing this
Dec 1 2023
Most of the patches are ready to go, the only thing missing is passing the variable to php-fpm. Our options here are either
Nov 28 2023
Files copied over :)
@jbond @Muehlenhoff It appears that we are missing GeoIP.dat, GeoIPRegion.dat, and GeoIPCity.dat from the new puppetmasters. Would it be alright if we'd just copied them over from the old puppetmasters for now?