For that particular image I can recreate locally:
refreshMessageBlobs was added in T222539
Tue, Jul 16
We use /mnt/docker now and it's got a lot of space.
This looks to be released as a feature on contint1001 now.
Mon, Jul 15
Fri, Jul 12
Thu, Jul 11
Ran in another terminal window after I got the message 22:10:59 Updating ExtensionMessages-1.34.0-wmf.13.php from scap
mergeMessageFileList which is what scap shells out to to handle building ExtensionMessages does a require_once on each of the files listed in the extension-list file. It then dumps $wgMessagesDirs into the ExtensionMessages file.
hrm, so WikibaseLib is in ExtensionMessages for 1.34.11, but not in ExtensionsMessages for 1.34.13
UBN since it's a deployment blocker.
Nothing looks to have changed with the actual json in the extension:
Hrm. That is bizarre.
Hi @Shirayuki I believe your issue should be resolved. Please re-open this ticket if you ware still unable to login.
Tue, Jul 9
didn't mean to change priority
[thcipriani@contint1001 mathoid ((cc375c7db...) %)]$ git status Not currently on any branch. Untracked files: (use "git add <file>..." to include in what will be committed)
Mon, Jul 8
This should now be resolved in production as of Tue, Jun 25, 7:45 AM when the new scap version (3.10.0-1) was released.
Hi @Shirayuki sorry for the delay
Wed, Jul 3
@CDanis I merged in the changes to the release branch and pushed up the debian/3.11.0-1 tag: you should be good to release from the scap side.
Tue, Jul 2
Applied patch and reindexed accounts 2019-07-02 17:53 UTC.
Mon, Jul 1
Fri, Jun 28
Thu, Jun 27
Investigated this a bit today. I was hoping with 3 incidents in one day that the trigger for this event might be obvious.
Tue, Jun 25
Spoke too soon. Gerrit 2.15.14 caused a lot of SendEmail locks (T224448: Gerrit http threads stuck behind sendemail thread). I have to rollback to 2.15.13. I will update wikitech as well.
This happened twice in the past 24 hours.
Mon, Jun 24
Config change has been deployed.
Fri, Jun 21
Thu, Jun 20
Jun 18 2019
Jun 17 2019
Jun 13 2019
Thanks for the enthusiasm :)
Jun 12 2019
Jun 11 2019
My theory here is that there is some ssh timeout on the phab side for pushing to gerrit (or maybe some error on the phab side(?)). I don't see anything in the gerrit error logs related to phab/editquality.
Looks like master is showing a newer version:
@brennen made the mistake of showing interest in this task, assigning accordingly :)
Jun 10 2019
Guessing this is the aborted clean from https://tools.wmflabs.org/sal/log/AWq2FV6OOwpQ-3Pk_Reb
Jun 9 2019
Jun 7 2019
This is due to gerrit using cn as the UI login (internally in gerrit this is the gerrit schema), while using uid as the ssh/api login (internally in gerrit this is the username schema).
Jun 6 2019
gate-and-submit-swat is for immediate-to-prod code. Yes, mw-config is in its own queue, but it should also have priority…
Jun 5 2019
I have gc info from right when this happened: https://gceasy.io/my-gc-report.jsp?p=c2hhcmVkLzIwMTkvMDYvNS8tLWp2bV9nYy5nZXJyaXQubG9nLjcuY3VycmVudC0tMjMtMjgtNTE=&channel=WEB
The pod that is running in the ci namespace of the staging cluster seems to be logging 504 errors:
Rerunning the test on contint1001 the failure message I see in the logs is:
Jun 4 2019
Jun 3 2019
What affect have the opcode_invalidate calls for specific files via sync-file had? Do we only see this corruption for opcache_reset?
Deployed on beta, the old method took ~25 seconds, new method takes ~5 seconds. I'll prep a new prod scap release.
May 28 2019
May 27 2019
Restarted Gerrit 2019-05-27T23:10,