Page MenuHomePhabricator

JSTOR link causes possible Event Emitter memory leak error
Closed, ResolvedPublic

Description

Request:

http://www.jstor.org/discover/10.1086/378695?uid=3739832&uid=2&uid=4&uid=3739256&sid=21105503736473

Traceback:

`
{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":20,"msg":"Zotero request made for: http://www.jstor.org/discover/10.1086/378695?uid=3739832&uid=2&uid=4&uid=3739256&sid=21105503736473","time":"2015-08-12T14:22:31.427Z","v":0}
{"name":"citoid.zotero.req.5xx","hostname":"mariellesbox","pid":14481,"level":10,"message":"increment:citoid.zotero.req.5xx:","method":"increment","levelPath":"trace/metrics","msg":"","time":"2015-08-12T14:22:31.436Z","v":0}
{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":10,"msg":"No Zotero translator found, looking for redirects","time":"2015-08-12T14:22:31.437Z","v":0}
(node) warning: possible EventEmitter memory leak detected. 11 listeners added. Use emitter.setMaxListeners() to increase limit.
Trace

at Request.EventEmitter.addListener (events.js:160:15)
at Request.init (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:496:8)
at Redirect.onResponse (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/lib/redirect.js:148:11)
at Request.onRequestResponse (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:931:22)
at ClientRequest.EventEmitter.emit (events.js:95:17)
at HTTPParser.parserOnIncomingClient [as onIncoming] (http.js:1688:21)
at HTTPParser.parserOnHeadersComplete [as onHeadersComplete] (http.js:121:23)
at Socket.socketOnData [as ondata] (http.js:1583:20)
at TCP.onread (net.js:527:27)

(node) warning: possible EventEmitter memory leak detected. 11 listeners added. Use emitter.setMaxListeners() to increase limit.
Trace

at Request.EventEmitter.addListener (events.js:160:15)
at Request.start (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:830:8)
at Request.end (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:1361:10)
at end (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:563:14)
at Object._onImmediate (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:577:7)
at processImmediate [as _immediateCallback] (timers.js:330:15)

{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":20,"msg":"No redirect detected.","time":"2015-08-12T14:22:36.557Z","v":0}
{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":20,"msg":"Using native scraper on http://www.jstor.org/discover/10.1086/378695?uid=3739832&uid=2&uid=4&uid=3739256&sid=21105503736473","time":"2015-08-12T14:22:36.558Z","v":0}
(node) warning: possible EventEmitter memory leak detected. 11 listeners added. Use emitter.setMaxListeners() to increase limit.
Trace

at Request.EventEmitter.addListener (events.js:160:15)
at Request.init (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:496:8)
at Redirect.onResponse (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/lib/redirect.js:148:11)
at Request.onRequestResponse (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:931:22)
at ClientRequest.EventEmitter.emit (events.js:95:17)
at HTTPParser.parserOnIncomingClient [as onIncoming] (http.js:1688:21)
at HTTPParser.parserOnHeadersComplete [as onHeadersComplete] (http.js:121:23)
at Socket.socketOnData [as ondata] (http.js:1583:20)
at TCP.onread (net.js:527:27)

(node) warning: possible EventEmitter memory leak detected. 11 listeners added. Use emitter.setMaxListeners() to increase limit.
Trace

at Request.EventEmitter.addListener (events.js:160:15)
at Request.start (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:830:8)
at Request.end (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:1361:10)
at end (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:563:14)
at Object._onImmediate (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:577:7)
at processImmediate [as _immediateCallback] (timers.js:330:15)

{"name":"citoid.heap.rss","hostname":"mariellesbox","pid":14481,"level":10,"message":"timing:citoid.heap.rss:77197312","method":"timing","value":77197312,"levelPath":"trace/metrics","msg":"","time":"2015-08-12T14:22:45.188Z","v":0}
{"name":"citoid.heap.total","hostname":"mariellesbox","pid":14481,"level":10,"message":"timing:citoid.heap.total:69551104","method":"timing","value":69551104,"levelPath":"trace/metrics","msg":"","time":"2015-08-12T14:22:45.188Z","v":0}
{"name":"citoid.heap.used","hostname":"mariellesbox","pid":14481,"level":10,"message":"timing:citoid.heap.used:37087360","method":"timing","value":37087360,"levelPath":"trace/metrics","msg":"","time":"2015-08-12T14:22:45.188Z","v":0}
(node) warning: possible EventEmitter memory leak detected. 11 listeners added. Use emitter.setMaxListeners() to increase limit.
Trace

at Request.EventEmitter.addListener (events.js:160:15)
at Request.init (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:496:8)
at Redirect.onResponse (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/lib/redirect.js:148:11)
at Request.onRequestResponse (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:931:22)
at ClientRequest.EventEmitter.emit (events.js:95:17)
at HTTPParser.parserOnIncomingClient [as onIncoming] (http.js:1688:21)
at HTTPParser.parserOnHeadersComplete [as onHeadersComplete] (http.js:121:23)
at Socket.socketOnData [as ondata] (http.js:1583:20)
at TCP.onread (net.js:527:27)

(node) warning: possible EventEmitter memory leak detected. 11 listeners added. Use emitter.setMaxListeners() to increase limit.
Trace

at Request.EventEmitter.addListener (events.js:160:15)
at Request.start (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:830:8)
at Request.end (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:1361:10)
at end (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:563:14)
at Object._onImmediate (/home/marielle/Code/Node/citoid/node_modules/preq/node_modules/request/request.js:577:7)
at processImmediate [as _immediateCallback] (timers.js:330:15)

{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":20,"msg":"Failed to scrape resource at http://www.jstor.org/discover/10.1086/378695?uid=3739832&uid=2&uid=4&uid=3739256&sid=21105503736473","time":"2015-08-12T14:22:48.783Z","v":0}
{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":40,"msg":"No citation metadata from crossRef","time":"2015-08-12T14:22:48.933Z","v":0}
{"name":"citoid","hostname":"mariellesbox","pid":14481,"level":20,"msg":"Sucessfully got metadata from doi 10.1086/378695?uid=3739832&uid=2&uid=4&uid=3739256&sid=21105503736473","time":"2015-08-12T14:22:48.934Z","v":0}

`

Event Timeline

Mvolz raised the priority of this task from to Needs Triage.
Mvolz updated the task description. (Show Details)
Mvolz added projects: Citoid, Services.
Mvolz moved this task to Service on the Citoid board.
Mvolz subscribed.

@Dzahn notes on https://gerrit.wikimedia.org/r/#/c/231005/ that the failing DOI url doesn't work in the browser either. Ergo this is likely unresolvable on our end.

Reported to the Zotero translator;
https://github.com/zotero/translators/issues/935

(This won't resolve the issue, just letting them know as well.)

Mvolz set Security to None.

Resolving as this looks like it's been fixed on JSTOR's end now.

Unless @mobrovac thinks there's an issue with how this error happened in citoid that merits further investigation? The browser reported "too many redirects" which is a different error message, and plus I don't think there was really an event emitter error, seems more likely this was some sort of timeout instead.

All good. The EventEmitter error happens when there are too many callbacks registered, which is the case when there are too many redirects.