Now that maps have been switched to full production environment, I think it is time to get rid of the Varnish referrer test. The potential downfall is that the whole world may start using these tiles, but on the good side - the whole world can use it for their experiments!
If it gets out of hand, we certainly can start introducing some abuse control, but for now we might as well let people experiment with it.
In the absolute minimum, we should remove any filtering for WMF-owned domains. This does NOT mean that we will enable Maps (Kartographer) extension on every project right away. It should be done with caution, especially for large WP projects.