Page MenuHomePhabricator

edsu (Ed Summers)
User

Projects

User does not belong to any projects.

Today

  • Clear sailing ahead.

Tomorrow

  • Clear sailing ahead.

Wednesday

  • Clear sailing ahead.

User Details

User Since
Jan 15 2015, 11:32 AM (252 w, 3 d)
Availability
Available
IRC Nick
edsu
LDAP User
Unknown
MediaWiki User
Edsu [ Global Accounts ]

I'm a software developer working in archives.

Recent Activity

Oct 12 2019

edsu closed T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu as Resolved.

Ahh, yes that works for me. Thank you for clarifying!

Oct 12 2019, 2:43 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS
edsu reopened T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu as "Open".

I'm sorry to have to reopen this. But I've been notified that wikistream.wmflabs.org is down again and I no longer seem to ssh with the the ProxyJump configuration? Here's the log of my ssh attempt:

Oct 12 2019, 2:30 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS

Sep 11 2019

edsu closed T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu as Resolved.

Thanks again for everyone's help.

Sep 11 2019, 2:51 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS
edsu added a comment to T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu.

@bd808 thank you! I only was doing the ssh-within-ssh because it worked for me in the past. But I've got ProxyJump working fine now, and can access ws-web, so I appreciate you taking the time to explain this solution.

Sep 11 2019, 2:51 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS

Sep 10 2019

edsu added a comment to T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu.

Thanks for getting wikistream back working again. I'm still unable to ssh in however.

Sep 10 2019, 11:39 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS
edsu added a comment to T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu.

Hmm, looking at the docs perhaps it's no longer possible to ssh to bastion.wmflabs.org and then ssh on to ws-web? Should I follow the instructions at this page to set up bast1002.wikimedia.org as a proxy?

Sep 10 2019, 3:37 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS
edsu added a comment to T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu.

Thanks for the quick response! Here you go:

Sep 10 2019, 3:08 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS
edsu created T232486: Unable to ssh to ws-web.wikistream.eqiad.wmflabs as user edsu.
Sep 10 2019, 2:45 PM · VPS-Projects, Documentation, cloud-services-team (Kanban), Cloud-VPS

Dec 19 2018

edsu closed T212309: wikistream.wmflabs.org 502 Bad Gateway as Resolved.

You're right, sorry for the false alarm.

Dec 19 2018, 4:19 PM · VPS-Projects
edsu created T212309: wikistream.wmflabs.org 502 Bad Gateway.
Dec 19 2018, 3:58 PM · VPS-Projects

Nov 27 2018

edsu added a comment to T185606: wikistream.wmflabs.org 502 Varnish Error.

The root partition on ws-web was full again. For some reason daemon.log in /var/log/ doesn't rotate properly. I've adjusted the code to squash excessive logging when running in production. Hopefully that will help in the future. You should find the service is running again.

Nov 27 2018, 12:52 AM · cloud-services-team (Kanban), Cloud-VPS

Apr 20 2018

edsu added a comment to T185606: wikistream.wmflabs.org 502 Varnish Error.

In the comment that you copy and pasted I did the second option of creating a systemd override. The trouble was that my override was overidden.

Apr 20 2018, 4:15 PM · cloud-services-team (Kanban), Cloud-VPS
edsu reopened T185606: wikistream.wmflabs.org 502 Varnish Error as "Open".

I recently noticed that wikistream was down (again) and I needed to update /lib/systemd/system/varnish.service again because something (Puppet?) overwrote my Varnish config change. Varnish needs to run on port 80, but something keeps resetting it to 6081, which is the default. Perhaps this happens when varnish is upgraded. I have no clue, but it's annoying to notice it's down again only to see the same problem has repeated.

Apr 20 2018, 10:06 AM · cloud-services-team (Kanban), Cloud-VPS

Apr 15 2018

edsu added a comment to T183826: "Error 503 Backend fetch failed" on wikistream.wmflabs.org.

I'm seeing a Varnish error at wikistream.wmflabs.org again. The backend on ws-web is working fine. I'm not quite sure what's going on upstream from the app. Can someone help?

Apr 15 2018, 6:03 PM · VPS-Projects

Jan 27 2018

edsu closed T185606: wikistream.wmflabs.org 502 Varnish Error as Resolved.
Jan 27 2018, 1:58 AM · cloud-services-team (Kanban), Cloud-VPS

Jan 26 2018

edsu added a comment to T185606: wikistream.wmflabs.org 502 Varnish Error.

I modified /lib/systemd/system/varnish.service to have varnish listen on port 80, since that's how it ran for quite a while (years?) without any trouble until recently. Thanks for the information about systemd, I was looking around in /etc/init and /etc/init.d.

Jan 26 2018, 11:54 PM · cloud-services-team (Kanban), Cloud-VPS
edsu added a comment to T185606: wikistream.wmflabs.org 502 Varnish Error.
Jan 26 2018, 11:36 PM · cloud-services-team (Kanban), Cloud-VPS

Jan 24 2018

edsu added a comment to T185606: wikistream.wmflabs.org 502 Varnish Error.

Varnish is running on ws-web, which proxies the wikistream app that listens on localhost:3000. A while ago (maybe a year, or more?) I configured Varnish to listen on 0.0.0.0:80 in /etc/default/varnish. But sudo service varnish start no longer seems to be reading that for reasons I do not understand. Instead Varnish is listening on port 6081.

Jan 24 2018, 8:43 PM · cloud-services-team (Kanban), Cloud-VPS

Jan 23 2018

edsu renamed T185606: wikistream.wmflabs.org 502 Varnish Error from wikistream.wmflabs.org 502 to wikistream.wmflabs.org 502 Varnish Error.
Jan 23 2018, 10:14 PM · cloud-services-team (Kanban), Cloud-VPS
edsu created T185606: wikistream.wmflabs.org 502 Varnish Error.
Jan 23 2018, 10:13 PM · cloud-services-team (Kanban), Cloud-VPS

Dec 31 2017

edsu added a comment to T183826: "Error 503 Backend fetch failed" on wikistream.wmflabs.org.

It is still maintained, at least by me when I notice it is down. It appeared that /var/log on ws-web filled up with lots of daemon.log.x files (9 GBs worth). I believe this caused the process to stop, and for it to not be able to restart.

Dec 31 2017, 2:34 PM · VPS-Projects

Nov 4 2017

edsu reopened T166830: Node.js on gridengine as "Open".
Nov 4 2017, 12:09 PM · User-bd808, Toolforge
edsu added a comment to T166830: Node.js on gridengine.

I'm a bit confused about how to get npm install to run under kubernetes with the docker-registry.tools.wmflabs.org/toollabs-nodejs-base:latest image. Is there an example of that somewhere?

Nov 4 2017, 12:09 PM · User-bd808, Toolforge

Oct 18 2017

edsu closed T166830: Node.js on gridengine as Resolved.
Oct 18 2017, 7:46 AM · User-bd808, Toolforge
edsu added a comment to T166830: Node.js on gridengine.

Ok, thanks for the details, this helps a lot. So it sounds like the way to move forward is to start using Kubernetes which I wanted to learn about anyway, and now I have a reason.

Oct 18 2017, 7:45 AM · User-bd808, Toolforge

Sep 7 2017

edsu closed T174850: wikistream.wmflabs.org down - unable to ssh to ws-web as Resolved.

Yes, I'm able to log in now. Thanks so much!

Sep 7 2017, 8:20 AM · Cloud-VPS

Sep 2 2017

edsu added a comment to T174850: wikistream.wmflabs.org down - unable to ssh to ws-web.

I don't know if T103148 is related or not. Maybe my homedir on ws-web was somehow modified?

Sep 2 2017, 12:50 PM · Cloud-VPS
edsu added a comment to T174850: wikistream.wmflabs.org down - unable to ssh to ws-web.

I can see that the ssh-key for my laptop's id_rsa.pub and the id_rsa.pub in my homedir on bastion.wmflabs.org are present in that list.

Sep 2 2017, 12:47 PM · Cloud-VPS
edsu created T174850: wikistream.wmflabs.org down - unable to ssh to ws-web.
Sep 2 2017, 11:06 AM · Cloud-VPS
edsu added a comment to T103148: Investigate NFS alternatives to the wikistream project.

I don't know if this is related but I'm unable to ssh from bastion.wmflabs.org to ws-web any longer. I notice the service is currently down and wanted to see what was wrong.

Sep 2 2017, 11:00 AM · Cloud-Services

Aug 6 2017

edsu added a comment to T166830: Node.js on gridengine.

The memory leak is a result of using the old version of node with the Cheerio library. If node can be upgraded that would help me. v0.10 is end-of-life and is no longer maintained.

Aug 6 2017, 5:49 PM · User-bd808, Toolforge

Jul 8 2017

edsu added a comment to T166830: Node.js on gridengine.

I actually have tried upping the memory. It just takes longer to run out of memory. I would like to upgrade Node if possible.

Jul 8 2017, 11:59 PM · User-bd808, Toolforge

Jun 1 2017

edsu created T166830: Node.js on gridengine.
Jun 1 2017, 7:38 PM · User-bd808, Toolforge

Nov 14 2016

edsu closed T150681: tools-bastion-03 read-only filesystem as Resolved.

Sorry I didn't see https://phabricator.wikimedia.org/T146154 before I opened this.

Nov 14 2016, 7:21 PM · Toolforge, Cloud-Services
edsu created T150681: tools-bastion-03 read-only filesystem.
Nov 14 2016, 7:19 PM · Toolforge, Cloud-Services

Jan 31 2016

edsu added a comment to T125349: `tools.anon` causing excessive I/O.

Sorry about that. I really had no idea it was such a large file when I started to grep it :-) I have since deleted it, which probably wasn't so nice to NFS either...oops!

Jan 31 2016, 6:08 PM · Tools, Toolforge, Cloud-Services

May 17 2015

edsu added a comment to T96247: Wikidata entity selector for 3rd party usage.

As a current user of Freebase Suggest, which is going away apparently on June 30th, it would be super to have a Wikidata based alternative. I suspect (but do not know) that there are other Freebase Suggest users who will need to migrate to something, and having a path to Wikidata would be good for Wikidata entities being used outside of the Wikipedia ecosystem.

May 17 2015, 11:28 AM · Wikidocumentaries, Wikimedia-Hackathon-2018, GLAM-Tech, Story, MediaWiki-extensions-WikibaseRepository, Wikidata

Jan 25 2015

edsu added a comment to T86905: Open Grid Engine Job dumps core (node).

Yes, this seemed to work:

Jan 25 2015, 10:35 PM · Toolforge

Jan 16 2015

edsu triaged T86905: Open Grid Engine Job dumps core (node) as Lowest priority.
Jan 16 2015, 1:31 PM · Toolforge

Jan 15 2015

edsu created T86905: Open Grid Engine Job dumps core (node).
Jan 15 2015, 11:43 AM · Toolforge