Page MenuHomePhabricator

Missing (all) us east metrics in WebPageTest
Closed, ResolvedPublic

Description

We are missing all metrics that we collect from our WebPageTest instance. The WebPageTest server is down/inaccessible and no runs are going through, see:

Screen Shot 2018-06-22 at 2.49.10 PM.png (1×2 px, 333 KB)

I logged into AWS and the server was running:

Screen Shot 2018-06-22 at 2.56.05 PM.png (132×2 px, 52 KB)

But I couldn't ssh to the server.

Related Objects

Event Timeline

On Jenkins we get errors like this:

12:23:39 Failing test: { Error: read ECONNRESET
12:23:39     at exports._errnoException (util.js:1018:11)
12:23:39     at TCP.onread (net.js:568:26)
12:23:39   cause: 
12:23:39    { Error: read ECONNRESET
12:23:39        at exports._errnoException (util.js:1018:11)
12:23:39        at TCP.onread (net.js:568:26) code: 'ECONNRESET', errno: 'ECONNRESET', syscall: 'read' },
12:23:39   isOperational: true,
12:23:39   code: 'ECONNRESET',
12:23:39   errno: 'ECONNRESET',
12:23:39   syscall: 'read' }

Let me login to the WebPageTest instance and check the logs.

Peter triaged this task as High priority.Jun 22 2018, 1:05 PM
Peter updated the task description. (Show Details)

I've stopped it, waiting for it to really stop, then starting it again and it works again.

Also I added alarms if there are no network traffic for the instance, that should let us know if this happens again.

Vvjjkkii renamed this task from Missing (all) us east metrics in WebPageTest to rgaaaaaaaa.Jul 1 2018, 1:02 AM
Vvjjkkii reopened this task as Open.
Vvjjkkii removed Peter as the assignee of this task.
Vvjjkkii updated the task description. (Show Details)
Vvjjkkii removed a subscriber: Aklapper.