Mon, Mar 19
This seems meaningless since wikitech doesn't do puppet config anymore.
Purging seems to work fine, but I can produce this exception any time I make an edit.
Fri, Mar 16
This seems to all work now but I'm going to wait 24 hours and check some test images I just added to wikitech
Yep, I think it's all better.
My suggestion is to close this without touching nova
Thu, Mar 15
I've moved all of this code into a new repo, git clone https://gerrit.wikimedia.org/r/operations/wikitech-static, in the wikitechsync subdir.
Wed, Mar 14
This is moot, californium is moving into the spare pool.
The new icinga test ('Wikitech-static main page has content') has been alerting critical for a while. The actual site seems to be up and working.
Tue, Mar 13
The other thumbnail issue was caused by an obsolete version of https://gerrit.wikimedia.org/r/#/c/196186/ on -static. Everything should work now presuming that whatever invokes Ariel's script (probably /usr/local/sbin/import-wikitech.sh) sets up ownership properly.
The first thumbnail issue seems to be fixed via chown -R ww-data <imagedir>. There's another bug behind that one which I'm working on.
I will give this a day to sync and verify that this works properly on -static.
Proposed site notice text: "You are browsing a read-only backup copy of Wikitech. The primary site can be found at https://wikitech.wikimedia.org"
Mon, Mar 12
Looks like I can just check $wgSiteName. Now I'm looking for how to modify the banner from within JS
morebots doesn't run anymore, cleaning this up.
- Silver will be decommissioned soon.
- We don't use novncproxy anymore as it was too scary from a security standpoint.
- I just stopped it from running on silver.
Do we need some equivalent change on labweb1001/1002 for this? Or do the varnishes take care of it now?
Soon silver will be decommissioned.
This should be moot as Silver is no longer doing important things.
Wikitech on Silver has been replaced by Wikitech on labweb1001/1002. The new wikitech uses HHVM.
When I make this change
Sun, Mar 11
Deleted. Thanks all!
I've removed mathoid.testme.wmflabs.org -- I don't see mathoid-rb.testme.wmflabs.org, do you still see it?
Sat, Mar 10
Fri, Mar 9
Once again, I suspect this of being fixed.
I've turned off 2fa for your wikitech/horizon account. You should be able to log in to wikitech, re-enable it, and set up a new key. Let me know if you run into trouble.
Yep, this is moot as silver is about to be switched off.
Hello! A few tasks for you first for ID confirmation:
I believe this to be fixed. @Chicocvenancio can you confirm?
Is there a way we can deploy a file in the git repo that loads the setting that you want managed via puppet instead?
@ArielGlenn There should be populated mw tables on wikitech-static that are updated daily. The images are probably a week or so out of sync since that process stopped working when I moved things over to swift.
This turns out to be a problem with a dirty deployment. On labweb1001:
My mistake, proper syntax is:
I can cut nutcracker out of the loop entirely, and then this issue goes away:
I assumed that this was some sort of memcached split-brain, but now I'm not so sure. I just did this test:
Thu, Mar 8
Wed, Mar 7
@BBlack, I suspect you're the one who would know an answer for this
It turns out there's nothing in this project, so I just deleted it.
This seems to work -- I uploaded a file on wikitech.wikimedia.org and viewed it on newwikitech.wikimedia.org. Uploading from newwikitech.wikimedia.org seems to work as well, but I'll be more convinced once the new wikitech setup is actually called 'wikitech' and there isn't a storm of confusion between the two domain names.
@Marostegui, I could do it tomorrow or Friday anytime after 15:00 UTC. Next week I'm out Monday, Tuesday, Wednesday.
Tue, Mar 6
Mon, Mar 5
I've moved all the files we need into swift. To use them, though, we need to turn on wmgUseClusterFileBackend and as soon as I do that wikitech starts wanting to talk to production dbs (m4, I suspect.)
<bd808> Bryan Davis andrewbogott: https://gerrit.wikimedia.org/r/#/admin/projects/mediawiki/extensions/WikimediaMaintenance is made for this kind of weirdly one-off thing
This is an artifact of the wikitech/newwikitech hack. It's fixed if I apply the following:
It looks like rebuildImages.php may provide some of the 'crawl all images' logic that I'll need for this
The only currently-existing script that I hope to keep on the new labweb boxes is this one:
Sat, Mar 3
New VMs in contintcloud were failing with
Fri, Mar 2
Thu, Mar 1
Is this something that would be more safely done with keystone-manage token_flush or is that unrelated?
Sorry I slept through this last night! I'm catching up. A few facts:
Wed, Feb 28
Yes, $CACHE_MISC includes the varnishes, but not lvs. See https://gerrit.wikimedia.org/r/#/c/413194/
Definitely both 'smalls'