Since the September 2, we've had three unexplained browser test failures. All were for Firefox on Linux.
In each case, the tests passed on the next run, without (known) changes to any aspect of the tests.
Screencasts of each test show now banner at all.
This might just be due to flakiness of the Beta Cluster, where the tests run. It could also be that we just need to add a delay to make sure the test waits for the banner bump. However, we've had a spate of unexplained banner display problems recently! So it's not impossible that this is related somehow...
2016/09/02 [[ https://integration.wikimedia.org/ci/job/selenium-CentralNotice/134/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/ | 134 ]] [[ http://saucelabs.com/jobs/74271fa1f82f4f8590e4121d2166412f | Sauce Labs job ]]
2016/09/05 [[ https://integration.wikimedia.org/ci/job/selenium-CentralNotice/134/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/testReport/junit/(root)/Crude%20banner%20display/Banner_one_is_displayed_for_low_roll/ | 138 ]] [[ http://saucelabs.com/jobs/e5dbcdf592144449a0b331da52111612 | Sauce Labs job ]]
2016/09/13 [[ https://integration.wikimedia.org/ci/job/selenium-CentralNotice/147/BROWSER=firefox,MEDIAWIKI_ENVIRONMENT=beta,PLATFORM=Linux,label=contintLabsSlave%20&&%20UbuntuTrusty/testReport/junit/(root)/Crude%20banner%20display/Banner_three_is_displayed_for_high_roll/ | 147 ]] [[ http://saucelabs.com/jobs/497ae773e1794f6c9888bdb14a7ee26d | Sauce Labs job ]]