Found in T120349, the localisation cache for qunit jobs is shared between runs. That is because it is written to /tmp.
The web env does not have TMPDIR injected. We need to:
- have mediawiki.d to explicitly set $wgTmpDirectory - https://gerrit.wikimedia.org/r/256912
- point localisation cache to a known dir