What we are specifically looking for is "observability" provided by some tooling; particularly we would like metrics on number and latency of requests. It appears that a common solution to this is using a service mesh since this functionality usually comes bundled in.

Some examples of service meshes to investigate are:

• Istio
• Linkerd

An more broad tool to look at might be: Cillium.

For a look at the landscape of tools it may be worth looking at the CNCF landscape. Particularly the Service Mesh or Cloud Native Network sections.

You can also look at how the WMF has rolled their own observability using an envoy sidecar pattern:

• some slightly out dated docs
• templating for a sidecar
• how its being used in the deployment