Page MenuHomePhabricator

Envoy adaptive concurrency for main api
Open, Needs TriagePublic

Description

Istio’s engine envoy supports adaptive concurrency which is a mechanism that ensures that the upstream servers perform under load and not get overwhelmed. Under heavy load when the API servers depict increased latency, istio will stop sending requests to such instances and if it is a case that all the available instances are under pressure, then it will return http 503s to the clients.