Page MenuHomePhabricator
Create Task
Maniphest T95971

Apache on Jenkins slave takes over 30s to respond (QUnit/AJAX "Test timed out")
Closed, ResolvedPublic
Actions

Description

It seems to be a timeout, but I'm not positive whether that's the initial cause.

Example: https://integration.wikimedia.org/ci/job/mwext-Flow-qunit/5259/consoleFull

23:07:03 Running "karma:main" (karma) task
23:07:03 INFO [karma]: Karma v0.12.31 server started at http://localhost:9876/
23:07:03 INFO [launcher]: Starting browser Chrome
23:07:08 INFO [Chromium 41.0.2272 (Ubuntu)]: Connected on socket g2H1FYYcHCxH1P6ZCTx- with id 8048802
23:07:18 Chromium 41.0.2272 (Ubuntu) ERROR: '[FLOW] ', 'Will not instantiate: no $container.length', Object{0: {length: 0, prevObject: {0: ..., context: ..., length: ...}, context: HTMLDocument{vlinkColor: ..., linkColor: ..., alinkColor: ..., fgColor: ..., bgColor: ..., compatMode: ..., all: ..., onautocompleteerror: ..., onautocomplete: ..., rootElement: ..., childElementCount: ..., lastElementChild: ..., firstElementChild: ..., children: ..., onwaiting: ..., onvolumechange: ..., ontoggle: ..., ontimeupdate: ..., onsuspend: ..., onsubmit: ..., onstalled: ..., onshow: ..., onselect: ..., onseeking: ..., onseeked: ..., onscroll: ..., onresize: ..., onreset: ..., onratechange: ..., onprogress: ..., onplaying: ..., onplay: ..., onpause: ..., onmousewheel: ..., onmouseup: ..., onmouseover: ..., onmouseout: ..., onmousemove: ..., onmouseleave: ..., onmouseenter: ..., onmousedown: ..., onloadstart: ..., onloadedmetadata: ..., onloadeddata: ..., onload: ..., onkeyup: ..., onkeypress: ..., onkeydown: ..., oninvalid: ..., oninput: ..., onfocus: ..., onerror: ..., onended: ..., onemptied: ..., ondurationchange: ..., ondrop: ..., ondragstart: ..., ondragover: ..., ondragleave: ..., ondragenter: ..., ondragend: ..., ondrag: ..., ondblclick: ..., oncuechange: ..., oncontextmenu: ..., onclose: ..., onclick: ..., onchange: ..., oncanplaythrough: ..., oncanplay: ..., oncancel: ..., onblur: ..., onabort: ..., onwebkitfullscreenerror: ..., onwebkitfullscreenchange: ..., webkitFullscreenElement: ..., webkitFullscreenEnabled: ..., webkitCurrentFullScreenElement: ..., webkitIsFullScreen: ..., fonts: ..., currentScript: ..., webkitHidden: ..., webkitVisibilityState: ..., hidden: ..., visibilityState: ..., onwheel: ..., onselectstart: ..., onselectionchange: ..., onsearch: ..., onreadystatechange: ..., onpointerlockerror: ..., onpointerlockchange: ..., onpaste: ..., oncut: ..., oncopy: ..., onbeforepaste: ..., onbeforecut: ..., onbeforecopy: ..., pointerLockElement: ..., activeElement: ..., selectedStylesheetSet: ..., preferredStylesheetSet: ..., characterSet: ..., readyState: ..., defaultCharset: ..., charset: ..., location: ..., lastModified: ..., anchors: ..., scripts: ..., forms: ..., links: ..., plugins: ..., embeds: ..., applets: ..., images: ..., head: ..., body: ..., cookie: ..., URL: ..., domain: ..., referrer: ..., title: ..., designMode: ..., dir: ..., contentType: ..., styleSheets: ..., defaultView: ..., origin: ..., documentURI: ..., xmlStandalone: ..., xmlVersion: ..., xmlEncoding: ..., inputEncoding: ..., documentElement: ..., implementation: ..., doctype: ..., parentElement: ..., textContent: ..., baseURI: ..., localName: ..., namespaceURI: ..., ownerDocument: ..., nextSibling: ..., previousSibling: ..., lastChild: ..., firstChild: ..., childNodes: ..., parentNode: ..., nodeType: ..., nodeValue: ..., nodeName: ..., jQuery111209100189129821956: ...}, selector: '.flow-component'}}
23:07:19 ................
23:07:19 ERROR: '[earthquake] Url exceeds maximum length'
23:07:19 .
23:07:19 ERROR: '[earthquake] Url exceeds maximum length'
23:07:19 ................................................................................
23:07:51 ........................................................................
23:07:51 Chromium 41.0.2272 (Ubuntu) mediawiki.jqueryMsg Match PHP parser FAILED
23:07:51 	Test timed out
23:07:51 	
23:07:51 	afterEach failed on Match PHP parser: Unfinished AJAX requests: 1
23:07:51 	Error: Unfinished AJAX requests: 1
23:07:51 	    at Object.teardown (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:781:911)
23:07:51 	    at Object.orgModule.teardown (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:779:829)
23:07:51 	    at Object.orgModule.teardown (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:779:455)
23:07:51 	    at runHook (/mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:916:20)
23:07:51 	    at process (/mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:573:24)
23:07:51 	    at begin (/mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:618:2)
23:07:51 	    at /mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:634:4
23:07:51 	
23:07:51 	Expected 50 assertions, but 32 were run
23:07:51 	    at http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:628:343
23:07:51 	    at http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:644:408
23:07:51 	    at runScript (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:160:591)
23:07:51 	    at execute (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:161:908)
23:07:51 	    at handlePending (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:159:131)
23:07:51 	    at runScript (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:160:603)
23:07:51 	    at execute (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:161:908)
23:07:51 	
23:07:51 Chromium 41.0.2272 (Ubuntu) mediawiki.jqueryMsg Links FAILED
23:07:51 	afterEach failed on Links: Unfinished AJAX requests: 1
23:07:51 	Error: Unfinished AJAX requests: 1
23:07:51 	    at Object.teardown (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:781:911)
23:07:51 	    at Object.orgModule.teardown (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:779:829)
23:07:51 	    at Object.orgModule.teardown (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:779:455)
23:07:51 	    at runHook (/mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:916:20)
23:07:51 	    at process (/mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:573:24)
23:07:51 	    at begin (/mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:618:2)
23:07:51 	    at /mnt/jenkins-workspace/workspace/mwext-Flow-qunit/src/node_modules/qunitjs/qunit/qunit.js:634:4
23:07:51 	
23:07:51 	Expected 6 assertions, but 7 were run
23:07:51 	    at http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:628:922
23:07:51 	    at http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=ext.echo.base%2Coverlay%7Cext.echo.overlay.tests%7Cext.eventLogging%2Cflow%7Cext.eventLogging.tests%7Cext.flow.components%2Ceditor%2Cparsoid%2Cpreview%2Ctemplating%2Ctests%7Cext.flow.components.tests%7Cext.flow.jquery.conditionalScroll%2CfindWithParent%7Cext.flow.vendor.storer%7Cjquery.accessKeyLabel%2CautoEllipsis%2CbyteLength%2CbyteLimit%2CcheckboxShiftClick%2Cclient%2Ccolor%2CcolorUtil%2Ccookie%2CgetAttrs%2Chidpi%2ChighlightText%2Clocalize%2CmakeCollapsible%2Cmw-jump%2CmwExtension%2Cplaceholder%2CtabIndex%2Ctablesorter%2CtextSelection%2Cthrottle-debounce%7Cmediawiki.Title%2CUri%2Capi%2Ccldr%2Ccookie%2CjqueryMsg%2Clanguage%2CmessagePoster%2Cnotify%2Cspecial%2Ctemplate%2Ctoc%2Cuser%2Cutil%7Cmediawiki.api.category%2Coptions%2Cparse%2Cwatch%7Cmediawiki.language.data%2Cinit%2Cmonths%7Cmediawiki.libs.pluralruleparser%7Cmediawiki.page.ready%2Cstartup%7Cmediawiki.special.recentchanges%7Cmediawiki.template.handlebars%7Cmediawiki.ui.anchor%7Cmoment%2Coojs%7Ctest.mediawiki.qunit.suites%2Ctestrunner%7Ctest.sinonjs%7Cuser.defaults&skin=fallback&version=20150413T230709Z&*:644:408
23:07:51 	    at runScript (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:160:591)
23:07:51 	    at execute (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:161:908)
23:07:51 	    at handlePending (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:159:131)
23:07:51 	    at runScript (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:160:603)
23:07:51 	    at execute (http://localhost:9876/jenkins-mwext-Flow-qunit-5259/load.php?debug=false&lang=en&modules=jquery%2Cmediawiki&only=scripts&skin=fallback&version=20150413T230611Z:161:908)

Related Objects
Search...

Event Timeline

• Mattflaschen-WMF created this task.Apr 13 2015, 11:24 PM
• Mattflaschen-WMF raised the priority of this task from to Needs Triage.
• Mattflaschen-WMF updated the task description. (Show Details)
• Mattflaschen-WMF added projects: MediaWiki-Internationalization, JavaScript, MediaWiki-Core-Tests.
• Mattflaschen-WMF subscribed.
Restricted Application added a subscriber: Aklapper. · View Herald TranscriptApr 13 2015, 11:24 PM
• Mattflaschen-WMF renamed this task from Intermittent mediawiki.jqueryMsg QUnit failures to Intermittent mediawiki.jqueryMsg QUnit failures under Karma.Apr 13 2015, 11:25 PM
• Mattflaschen-WMF set Security to None.
Krinkle subscribed.EditedApr 14 2015, 1:33 AM

Unrelated to Flow.
Unrelated to mediawiki.jqueryMsg.

Tests are timing out because it involves an AJAX request.

AJAX request is timing out because the Apache on the labs instance is intermittently unable to read from disk for long periods at a time. After 30 seconds, QUnit times out.

Krinkle renamed this task from Intermittent mediawiki.jqueryMsg QUnit failures under Karma to Apache on Jenkins slave can take over 30s to respond.Apr 14 2015, 1:34 AM
Krinkle triaged this task as High priority.
Krinkle edited projects, added Continuous-Integration-Infrastructure; removed MediaWiki-Internationalization.
Krinkle moved this task from Untriaged to Next on the Continuous-Integration-Infrastructure board.
hashar subscribed.Apr 14 2015, 8:24 AM

We had a labs outage yesterday and it was probably still going on at the time the report has been created.

Krinkle added a comment.EditedApr 15 2015, 6:46 PM

Nope, this still happens quite often.

https://integration.wikimedia.org/ci/job/mwext-VisualEditor-qunit/15050/consoleFull

00:02:22.644 Chromium 41.0.2272 (Ubuntu) mediawiki.jqueryMsg Match PHP parser FAILED
00:02:22.644 	Test timed out
00:02:22.644 	
00:02:22.644 	afterEach failed on Match PHP parser: Unfinished AJAX requests: 1
00:02:22.644 .............

I don't see anything out of the ordinary in the attached debug logs for the load.php? language.data..lang=xx requests spawned by this test. I guess it's just slow. Maybe some I/O lock somewhere.

This is a new error. Not related to the sqlite locks and other slowness we encountered last year (which happened to also affect the "mediawiki.jqueryMsg" test).

Krinkle renamed this task from Apache on Jenkins slave can take over 30s to respond to Apache on Jenkins slave takes over 30s to respond (QUnit/AJAX "Test timed out").Apr 15 2015, 7:52 PM
Krinkle claimed this task.Apr 15 2015, 10:00 PM
Krinkle moved this task from Next to In-progress on the Continuous-Integration-Infrastructure board.
Krinkle added a comment.EditedApr 15 2015, 10:53 PM

This also affects builds for MediaWiki extensions (e.g. Flow, VisualEditor, Gather, ..), and MediaWiki core builds for REL1_25.

So we can rule out commits to MediaWiki core after the 1.25 branch cut. And we can rule out any CI specific logic related to "master" branches.

The test in question timing out is mediawiki.jqueryMsg.test (see mediawiki/mediawiki.jqueryMsg.test.js#L306-L329). It makes a load.php request for the "language.data" module in various languages (see js/getMwLanguage). It does not run anything in parallel. It handles each language serially.

Example failures:

I checked the following logs so far:

  • Build log: QUnit reports "Test timed out" (as the test is still waiting for load.php to respond, it does not call QUnit.start within 30s).
  • No notices or warnings from PHP or MediaWiki were emitted (empty logs).
  • build/log/mw-debug-www: It records the various "/load.php?..lang=...&modules=mediawiki.language.data" requests. No errors.
  • Checked /var/log/apache/qunit_access.log on e.g. integration-slave-trusty-1012.eqiad.wmflabs. The requests are recorded here.
  • Checked /var/log/apache/qunit_error.log on e.g. integration-slave-trusty-1012.eqiad.wmflabs. Nothing out of the ordinary.
  • Checked /var/log/mysql.log, /var/log/mysql.err and /var/log/mysql/error.log. These files are actually empty..

The delay could be caused by a number of factors. For the moment I'll shelve this in favour of switching MySQL to use tmpfs. It seems plausible that stalling during MySQL interaction would also cause http requests for MediaWiki to time out.

Legoktm subscribed.Apr 16 2015, 3:17 AM
Krinkle mentioned this in T96230: Switch MySQL storage to tmpfs.Apr 16 2015, 5:16 AM
• Mattflaschen-WMF unsubscribed.Apr 16 2015, 6:07 AM
hashar added a subtask: T96249: MySQL tuning on CI slaves (tracking).Apr 16 2015, 2:31 PM
Krinkle closed this task as Resolved.Apr 17 2015, 3:50 PM

Haven't seen these time outs for at least 24 hours. Re-open if it comes back but for now I'll attribute these time outs to disk slowness in labs that presumably surfaced through MySQL time outs. Which in turn would've caused these http requests to MediaWiki to time out.

Resolved (for others reason) by switching MySQL datadir to tmpfs (T96230).

Krinkle moved this task from In-progress to Done on the Continuous-Integration-Infrastructure board.Apr 17 2015, 3:50 PM
Krinkle closed subtask T96249: MySQL tuning on CI slaves (tracking) as Resolved.Feb 16 2016, 2:30 PM
Content licensed under Creative Commons Attribution-ShareAlike (CC BY-SA) 4.0 unless otherwise noted; code licensed under GNU General Public License (GPL) 2.0 or later and other open source licenses. By using this site, you agree to the Terms of Use, Privacy Policy, and Code of Conduct. · Wikimedia Foundation · Privacy Policy · Code of Conduct · Terms of Use · Disclaimer · CC-BY-SA · GPL