Thu, May 6
Tue, May 4
1.37.0-wmf.4 has been on group0 for several hours. No apparent errors. Train looks good.
Fri, Apr 30
Wed, Apr 21
Thu, Apr 8
Apr 8 2021
Some additional measurements:
Apr 7 2021
Apr 6 2021
@Reedy scap does not do anything directly related to the LocalisationUpdate extension, so it should be safe to disable.
For the record https://gerrit.wikimedia.org/r/c/mediawiki/core/+/667735 replaced --no-clear-message-blob-store with --offline.
Apr 5 2021
vmstat data: https://phabricator.wikimedia.org/P15150
Mar 24 2021
Is this a regression in .36 ?
Mar 23 2021
Mar 22 2021
Mar 19 2021
@Dzahn If scap-master-sync is what it used to keep deploy2002 with deploy1002, and scap-master-sync excludes */cache/l10n/*.cdb, how are these files ending up on deploy2002?
Can someone knowledgeable tell me if these errors have any ill effects other than on logs?
Still seeing User not found by actor ID: messages at a lot rate (< 8 / hour). Most are from jobrunner.discovery.wmnet with en.wikipedia.org coming in second.
Sorry about the incomplete deployment. The fix is really deployed now.
Mar 18 2021
All wikis at .35
Mar 17 2021
Thanks for the risk report @Catrope
group0 and group1 at 1.36.0-wmf.35
group0 at 1.36.0-wmf.35
Mar 16 2021
@Ladsgroup The backport has been merged.
Is this still being considered a train blocker?
Mar 15 2021
Much appreciation for this change!
Mar 12 2021
The affected hosts are
This started happening after https://gerrit.wikimedia.org/r/c/operations/puppet/+/666787 was merged.
Mar 11 2021
Mar 10 2021
Mar 8 2021
Mar 2 2021
@Andrew The project I was hoping to implement using WMCS and nested VMS didn't work out due to too many levels of VMs. It would still be nice to be able to use qemu on WMCS nodes but for the time being that is no longer a requirement.
If it helps yall make progress, I have no objection to removing the vmx flag change that was added on my behalf not too long ago.
Feb 25 2021
Thanks for the investigation @Daimona. I would greatly appreciate that closer look.
This appears to be a regressions from .31
Feb 24 2021
Feb 23 2021
@Umherirrender Thanks for the update. That's good news.
This is still happening in bursts. Here's a recent sample:
Feb 19 2021
Thanks @MoritzMuehlenhoff! I verified that I can log in and sudo as needed.
Thanks for the reference @akosiaris. That was a good read.