Oh thanks, I guess something big changed between chrome 53 and 54 to cause the cross origin error to spread.

Should we set Access-Control-Allow-Origin: * in apache?

Should we make the qunit test non voting for now?

Is this a bug in chrome or does something need to be updated in mw to fix this?

Another user reported this problem on irc

<SMalyshev> is something wrong with qunit tests? I'm getting failures on patches where everything worked before, e.g. https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit-jessie/19472/console

He says it breaks all merges in CirrusSearch

<SMalyshev> paladox: thank you! looks like it breaks all merges for CirrusSearch :( will wait for resolution then

Change 328217 had a related patch set (by Paladox) published:
Downgrade Chromium to 53.0.2785

https://gerrit.wikimedia.org/r/328217

Oh wow stretch is using an old version of chromium https://packages.debian.org/stretch/chromium should apt-get from that source and then pin it.

Change 328238 had a related patch set uploaded (by Paladox):
Temporarily make mediawiki-extensions-qunit-jessie non voting

https://gerrit.wikimedia.org/r/328238

karma/static/context.js was removed in v1.1.0. Chances are karma is serving up some HTML error page and Chrome is trying to execute it as HTML an failing (and giving this super unhelpful message - why are the assets loaded cross-domain?)

Probably unrelated Wikidata errors in the CI log filed as T153729: CI tests throw warning "Cannot find site mywiki in sites table".

Apparently not unrelated after all.

This is still breaking. https://gerrit.wikimedia.org/r/#/c/328027/ failed to merge twice today, both times due to "Script error" from the qunit job even though the change doesn't touch any JS. https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit-jessie/19522/console

I haven't noticed that task yesterday, will try to reproduce. That looks like a race condition in one of the test suite :( Gotta find out whether it is a regression in Chromium, a change in the CI infra, an issue with mediawiki/core or one of the extensions :-/

@Tgr the "Cannot find site mywiki in sites table" has been going on for ages. I don't think it is related at all.

Looking at the build history:

$ grep  'Script error'  /srv/jenkins/builds/*qunit*/*/log|cut -d\/  -f5|uniq -c
      3 mediawiki-core-qunit-jessie
     70 mediawiki-extensions-qunit-jessie

mediawiki-core-qunit-jessie runs against mediawiki/core and has no dependencies beside mediawiki/vendor. The failing builds are:

Note that Gerrit change 325049 hasn't been merged. I have rebuild 9842 twice (in Jenkins UI with the Rebuild link in the web interface) and it failed with the same error. So it seems those patches manage to reproduce the issue at hand.

I have triggered the build against the master branch and it passed three times  10304  10305  10306.

In T153597#2889448, @hashar wrote:

Looking at the build history:

$ grep  'Script error'  /srv/jenkins/builds/*qunit*/*/log|cut -d\/  -f5|uniq -c
      3 mediawiki-core-qunit-jessie
     70 mediawiki-extensions-qunit-jessie

mediawiki-core-qunit-jessie runs against mediawiki/core and has no dependencies beside mediawiki/vendor. The failing builds are:

Time	Gerrit	Console	Chromium
Dec 12 16:05 UTC	325049/13	9842	Chrome 53.0.2785
Dec 12 16:14:41 UTC	325049/14	9843	Chrome 53.0.2785
Dec 16 21:47:08 UTC	325049/15	10154	Chrome 55.0.2883

Note that Gerrit change 325049 hasn't been merged. I have rebuild 9842 twice (in Jenkins UI with the Rebuild link in the web interface) and it failed with the same error. So it seems those patches manage to reproduce the issue at hand.

I have triggered the build against the master branch and it passed three times  10304  10305  10306.

Yep I find that strange as some of my recheck's a few days ago failed but then doing a recheck on one patch worked. So could the problem be when you touch a specific file?

In T153597#2889448, @hashar wrote:

Looking at the build history:

$ grep  'Script error'  /srv/jenkins/builds/*qunit*/*/log|cut -d\/  -f5|uniq -c
      3 mediawiki-core-qunit-jessie
     70 mediawiki-extensions-qunit-jessie

mediawiki-core-qunit-jessie runs against mediawiki/core and has no dependencies beside mediawiki/vendor. The failing builds are:

Time	Gerrit	Console	Chromium
Dec 12 16:05 UTC	325049/13	9842	Chrome 53.0.2785
Dec 12 16:14:41 UTC	325049/14	9843	Chrome 53.0.2785
Dec 16 21:47:08 UTC	325049/15	10154	Chrome 55.0.2883

Note that Gerrit change 325049 hasn't been merged. I have rebuild 9842 twice (in Jenkins UI with the Rebuild link in the web interface) and it failed with the same error. So it seems those patches manage to reproduce the issue at hand.

I have triggered the build against the master branch and it passed three times  10304  10305  10306.

Per @Nikkerabbit it could be caused by https://sentry.io/answers/javascript-script-error/

https://phabricator.wikimedia.org/T153597#2885879

I eventually broke my Apache/PHP local config and fought with karma/qunit configuration for the rest of the day. I am still not able to run the qunit tests locally to reproduce :-(

@hashar what about setting up a vm or using labs?

I had a couple totally unrelated issue fixed via

• T153756: Karma qunit should support Chromium
• T153757: Karma qunit proxy fails setting Host: header

I have reproduced the Script error locally by using https://gerrit.wikimedia.org/r/#/c/325049/15

git fetch https://gerrit.wikimedia.org/r/mediawiki/core refs/changes/49/325049/15
git checkout -b 325049/15 FETCH_HEAD
grunt karma:main
20 12 2016 17:09:31.691:INFO [Chrome 55.0.2883 (Mac OS X 10.11.4)]: Connected on socket ...
20 12 2016 17:09:31.762:DEBUG [web-server]: serving (cached): /Users/amusso/projects/mediawiki/core/node_modules/karma-qunit/lib/adapter.js
Chrome 55.0.2883 (Mac OS X 10.11.4) ERROR
  Script error.
20 12 2016 17:09:35.247:DEBUG [karma]: Run complete, exiting.

Change 328396 had a related patch set uploaded (by Hashar):
(DO NOT SUBMIT) karma without browser security

https://gerrit.wikimedia.org/r/328396

Change 328396 abandoned by Hashar:
(DO NOT SUBMIT) karma without browser security

https://gerrit.wikimedia.org/r/328396

Eventually I made a new karma configuration that pass to Chrome --disable-web-security https://gerrit.wikimedia.org/r/#/c/328396/ . That let it interpret faulty javascript and get Karma to report the error:

Chrome 55.0.2883 (Mac OS X 10.11.4) ERROR
  Uncaught SyntaxError: Unexpected token <
  at http://localhost/index.php?title=Special:JavaScriptTest/qunit/export:1

Using https://gerrit.wikimedia.org/r/#/c/325049/15 , the request for Special:JavaScriptTest/qunit/export spurts a PHP notice:

<br />
<font size='1'><table class='xdebug-error xe-notice' dir='ltr' border='1' cellspacing='0' cellpadding='1'>
<tr><th align='left' bgcolor='#f57900' colspan="5"><span style='background-color: #cc0000; color: #fce94f; font-size: x-large;'>( ! )</span> Notice: Undefined index: rcdays in mediawiki/core/includes/Setup.php on line <i>285</i></th></tr>
...

Which is well, invalid Javascript. I have no idea why Karma does not manage to capture the error from Chrome console unless one pass --disable-web-security.

So my best assumption is that sometime a notice ends up being thrown in the qunit export. And maybe the wikibase sites misconfiguration could cause it. Maybe we can dig in the debug log attached to https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit-jessie/ and see whether some specific error are emitted on the failing builds :/

@hashar that was caused in https://github.com/wikimedia/mediawiki/search?utf8=%E2%9C%93&q=rcdays+ which was a year ago.

Change 328401 had a related patch set uploaded (by Hashar):
Capture qunit curl commands log JavaScriptTest output

https://gerrit.wikimedia.org/r/328401

https://gerrit.wikimedia.org/r/328401 Capture qunit curl commands + log JavaScriptTest output

That will do a curl on JavaScriptTest and attach the output to the build. The place I am working from is closing down though, so I can't not deploy it now :-\

Change 328401 merged by jenkins-bot:
Capture qunit curl commands log JavaScriptTest output

https://gerrit.wikimedia.org/r/328401

I have updated the job mediawiki-extensions-qunit-jessie which now captures the output of:

curl --include /index.php/Special:BlankPage
curl --include /load.php?debug=true&modules=startup&only=scripts
curl --include /index.php?title=Special:JavaScriptTest/qunit/export

In T153597#2888880, @Tgr wrote:

Probably unrelated Wikidata errors in the CI log filed as T153729: CI tests throw warning "Cannot find site mywiki in sites table".

You were right after all! I have seen at least one occurrence of /index.php?title=Special:JavaScriptTest/qunit/export that had "Cannot find site mywiki in sites table". And I guess that causes the web browser to bails out with the script error.

@hashar depending on @Tgr fix for wikidata it still dosent fix qunit, see https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit-jessie/19643/console

Looks like it'' still broken for me: https://integration.wikimedia.org/ci/job/mediawiki-extensions-qunit-jessie/19645/console

@Smalyshev hi, the patches @hashar did is for debugging purposes. You can force merge for now if you are sure your patch dosent break anything. 

I see in the error log this:

2016-12-20 23:29:55 ci-jessie-wikimedia-462382 jenkins_u0_mw: [43362324fd2c4695892da59f] [no req] ErrorException from line 309 of /home/jenkins/workspace/mediawiki-extensions-qunit-jessie/src/includes/debug/MWDebug.php: PHP Notice: Cannot find site mywiki in sites table [Called from Wikibase\Client\WikibaseClient::newSiteGroup in /home/jenkins/workspace/mediawiki-extensions-qunit-jessie/src/extensions/Wikidata/extensions/Wikibase/client/includes/WikibaseClient.php at line 734]

That is filled as T153729

But that has been warning has been there for 1+ year.

@Smalyshev https://gerrit.wikimedia.org/r/#/c/328326/3 will probably fix this, I am not familiar with the WMDE build setup though (how does a Wikibase patch get into the Wikidata repo?)

Well I guess if it works with Depends-On then it will work after merging it, too...

In T153597#2891579, @Paladox wrote:

But that has been warning has been there for 1+ year.

It was there in the update.php run but not in wiki pages (you can see it in Special:BlankPage as well now). Apparently some change caused WikibaseClient::newSiteGroup() to be triggered on (some?) pageviews as well.

@Tgr was right, this https://gerrit.wikimedia.org/r/#/c/328443/2 does fix it.

Change 328326 had a related patch set uploaded (by Gergő Tisza):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/328326

Change 328445 had a related patch set (by Paladox) published:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/328445

Change 328326 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/328326

Change 328445 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/328445

Change 328217 abandoned by Paladox:
Contint: Downgrade Chromium to 53.0.2785

https://gerrit.wikimedia.org/r/328217

Change 328238 abandoned by Paladox:
Temporarily make mediawiki-extensions-qunit-jessie non voting

https://gerrit.wikimedia.org/r/328238

Change 328327 abandoned by Gergő Tisza:
[TEST] test for CI qunit breakage

https://gerrit.wikimedia.org/r/328327

It seems this still fails in https://gerrit.wikimedia.org/r/#/c/328113/
But passes in other patches.

(I still don't understand why https://gerrit.wikimedia.org/r/#/c/328327/ passed the tests, even though it depended on Wikibase and not Wikidata, but don't care sufficiently to spend time on it.)

Change 329774 had a related patch set uploaded (by Paladox):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/329774

Change 329775 had a related patch set uploaded (by Paladox):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/329775

Change 331533 had a related patch set uploaded (by Reedy):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331533

Change 331533 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331533

Change 331542 had a related patch set uploaded (by Reedy):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331542

Change 331542 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331542

Change 331548 had a related patch set uploaded (by Reedy):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331548

Change 331548 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331548

Change 331571 had a related patch set uploaded (by Reedy):
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331571

Change 329774 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/329774

Change 331571 merged by jenkins-bot:
Remove warning about missing site ID

https://gerrit.wikimedia.org/r/331571

This proposal is selected for the Developer-Wishlist voting round and will be added to a MediaWiki page very soon. To the subscribers, or proposer of this task: please help modify the task description: add a brief summary (10-12 lines) of the problem that this proposal raises, topics discussed in the comments, and a proposed solution (if there is any yet). Remember to add a header with a title "Description," to your content. Please do so before February 5th, 12:00 pm UTC.

This task is about a specific issue that has been fixed. I don't see much point in adding it to the developer wishlist.

Should this be closed then?

Change 345392 had a related patch set uploaded (by Krinkle):
[integration/config@master] qunit: Remove obsolete 'tac|tac' hack

https://gerrit.wikimedia.org/r/345392

Change 345392 merged by jenkins-bot:
[integration/config@master] qunit: Remove obsolete 'tac|tac' hack

https://gerrit.wikimedia.org/r/345392

Change 329775 merged by Hashar:
[mediawiki/extensions/Wikidata@REL1_27] Remove warning about missing site ID

https://gerrit.wikimedia.org/r/329775