We have an AWS server up and running but I've used it for testing, so we should setup a new instance:

• Setup a static ip
• Add AWS monitoring (make sure we watch the disk space) - added CPU check for now
• Keep the instance clean (the current version we docker prune in the crontab after a complete run)
• Use a new namespace in Graphite: When I setup Firefox I've seen that I missed adding a browser field so FF/Chrome collide
• Use an infinite loop to run the tests instead of the crontab as proposed by @Gilles
• Update https://wikitech.wikimedia.org/wiki/Performance/WebPageReplay to be correct
• Update Grafana dashboards to reflect the changes
• Update Grafana alerts

Lets do this next week when we have run Firefox over the weekend and collected data