T224879 caused the extension to stop calling the morelike api endpoints. It's currently served by CirrusSearch and Elasticsearch but these services cannot survive the traffic of our large wikipedias without our various cache layers (varnish + MW ObectCache).
So when the extension is broken for too long the caches are being invalidated and when the extension is fixed it must be re-activated gradually to avoid causing an incident.
This ticket is about creating a browser test to mitigate the issue by detecting any defects earlier.
Related incident report: https://wikitech.wikimedia.org/wiki/Incident_documentation/20190606-CirrusSearch-MoreLike