Istio’s engine envoy supports adaptive concurrency which is a mechanism that ensures that the upstream servers perform under load and not get overwhelmed. Under heavy load when the API servers depict increased latency, istio will stop sending requests to such instances and if it is a case that all the available instances are under pressure, then it will return http 503s to the clients.
Description
Description
| Status | Subtype | Assigned | Task | ||
|---|---|---|---|---|---|
| Open | None | T398211 [Business as Usual work Q1-Q2 FY 24/26] On Demand API stability improvements | |||
| Open | None | T398002 Envoy adaptive concurrency for main api |