Since https://gerrit.wikimedia.org/r/c/operations/puppet/+/478200 the Docker base images provided by SRE now ship with:
ENV LC_ALL C.UTF8
And locale=C
Hence we no more need that huge env in the CI base images:
ENV LANG='en_US.UTF-8' LANGUAGE='en_US:en' LC_ALL='en_US.UTF-8'
And can stop installing the locale package.
Reference: T210260#4823617