SRE team noticed that a specific host (mc1023) is close to saturating the uplink network connection . More investigation into the grafana graphs for the entire cluster  showed that this is a recurring pattern that seems to follow hosts around. Doing a memkeys on mc1023 we found out that the key
is doing >600Mbps of traffic. The fact the train version is coded in the key name supports the theory of the key name following the train and being hashed to a different server, explaining the fact the traffic seems to follow hosts around.
This will cause an outage soon, needs to be fixed