I haven't pushed any Firefox tests to the continuous tests since there where some problem at the beginning. We should at least have a couple of tests, so let me start by adding one for WebPageReplay and one for first view.
- Mentioned In
- rPMSM589e43898036: Test four URLs with Firefox.
rPMSMc33f27980250: Fix typeo for Firefox tests.
rPMSM8b0b4bf84197: Increase number of Firefox runs and test another URL.
rPMSM897b88f85cb0: Enable Firefox tests again.
rPMSM9ff7f08968c3: Disable Firefox tests for first view.
rPMSM181b617b90ea: Add last URLs for Firefox WebPageReplay tests.
rPMSM2826093854b9: Let Firefox firstview tests report under the right keys.
rPMSM2851bca2a7ae: Fix relative path to configuration file.
rPMSMdb526098310e: Try out as clean configuration for Firefox as possible.
rPMSM7233567d40b3: Add one more tests for Firefox.
rPMSM23d4d1a60228: Do not run prewarm server for Firefox.
rPMSMae00b5c0182c: Fix correct path to the Firefox download.
rPMSM66cf13903467: Add one test to run on Firefox for first view tests.
rPMSM575e9bc9996d: Run one URL test with WebPageReplay for Firefox.
rPMSM77dd08610dc5: Add Firefox tests to our first view tests.
Hmm we still get these kind of things where Firefox do not start at first try:
[2022-10-04 20:53:43] INFO: Skip install HAR trigger on Android [2022-10-04 20:54:43] INFO: firefox failed to start, trying 2 more time(s): Failed to start firefox in 60 seconds. [2022-10-04 20:54:43] INFO: Skip install HAR trigger on Android
By default we install a browser extension that helps us adding things like requests headers on Firefox. That works fine locally but on Bitbar that seems to cause timeouts (there's some extra kb that goes over the wire to the phones). I've disabled that for our tests now and added one single Firefox tests for first view and one for WebPageReplay for now.
There's still something strange going on with the first view tests for Firefox:
[2022-10-09 04:48:31] INFO: firefox failed to start, trying 2 more time(s): Failed to decode response from marionette
Lets try to setup the configuration for Firefox from scratch.