Since Dec 4th, I'm seeing an increase in errors that seem to be caused by Saucelabs. Tests were fine before that date, or at least failures were plausible. But recently more and more errors of the kind of "Sauce could not start your job." start popping up. Strangely there are days where this error does not happen, while on another day it is happening several times per build.
E.g. December 10th seemed to be a bad day for Saucelabs.
Looks like the tests are failing randomly :(
| Build | Test | Error | Sauce Labs | Sauce Labs Error |
|--|--|--|--|--|
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/258/testReport/ | 258 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/258/testReport/(root)/Edit%20sitelinks/Remove_multiple_sitelinks/ | Edit sitelinks.Remove multiple sitelinks ]] | Net::ReadTimeout | http://saucelabs.com/jobs/a31d28114680489485963f5d27bea5ae | Internal Server Error |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/257/testReport/ | 257 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/257/testReport/(root)/Using%20url%20properties%20in%20statements/Check_UI_for_invalid_values__outline_example_____missing_http_org___/ | Using url properties in statements.Check UI for invalid values (outline example : missing.http.org ) ]] | Selenium::WebDriver::Error::UnknownError | http://saucelabs.com/jobs/a0692d83dcd848fc890217f3785f61ce https://saucelabs.com/jobs/429a4fa845de4a009a35b5f8bd856a6e | null, The Sauce VMs failed to start the browser or device. For more info, please check https://wiki.saucelabs.com/display/DOCS/Common+Error+Messages |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/256/testReport/ | 256 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/256/testReport/(root)/Setting%20snaktypes%20of%20statements/Change_the_snaktype_and_save__outline_example_____somevalue___/ | Setting snaktypes of statements.Change the snaktype and save (outline example : somevalue ) ]] | Net::ReadTimeout | http://saucelabs.com/jobs/2e7df09a1b4f40e9b61e3e815e03b7d1, http://saucelabs.com/jobs/2455da0a2be84a3bb91069fea3881ded | null, The connection with your VM was lost and your job can't complete. You won't be charged for these minutes. For help, please check https://wiki.saucelabs.com/display/DOCS/Common+Error+Messages |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/256/testReport/ | 256 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/256/testReport/(root)/Using%20monolingual%20properties%20in%20statements/Adding_a_statement_of_type_monolingual__outline_example_____English___/ | Using monolingual properties in statements.Adding a statement of type monolingual (outline example : English ) ]] | Selenium::WebDriver::Error::UnknownError | https://saucelabs.com/jobs/65530e0b4f034a4291cc4b814f484b86 | The Sauce VMs failed to start the browser or device. For more info, please check https://wiki.saucelabs.com/display/DOCS/Common+Error+Messages |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/255/testReport/ | 255 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/255/testReport/(root)/Edit%20aliases/Type_new_alias/ | Edit aliases.Type new alias ]] | Selenium::WebDriver::Error::UnknownError | https://saucelabs.com/jobs/5781c8559fbf401f8f454396bc021a21 | The Sauce VMs failed to start the browser or device. For more info, please check https://wiki.saucelabs.com/display/DOCS/Common+Error+Messages |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/255/testReport/ | 255 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/255/testReport/(root)/Edit%20label/Modify_the_label/ | Edit label.Modify the label ]] | Selenium::WebDriver::Error::UnknownError | https://saucelabs.com/jobs/aa642a7c67f841e28421f60342c63f29 | The Sauce VMs failed to start the browser or device. For more info, please check https://wiki.saucelabs.com/display/DOCS/Common+Error+Messages |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/255/testReport/ | 255 ]] | [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/255/testReport/(root)/Property%20smoke%20test/Click_statement_add_button/ | Property smoke test.Click statement add button ]] | Selenium::WebDriver::Error::UnknownError | https://saucelabs.com/jobs/914b045996e84b42b6d4b0212960abaa | The Sauce VMs failed to start the browser or device. For more info, please check https://wiki.saucelabs.com/display/DOCS/Common+Error+Messages |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/254/testReport/ | 254 ]] | | - | | |
| [[ https://integration.wikimedia.org/ci/view/Selenium/job/selenium-Wikibase/BROWSER=chrome,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/253/testReport/ | 253 ]] | | - | | |