TBTom Becker
Building a model gateway with Envoy and gRPC
Routing, retries, and rate limits in front of your inference fleet.
@daniel
Staff SRE — Kubernetes & scaling
I write about running stateful inference workloads on Kubernetes without losing sleep.
2
Stories
217
Views
17
Likes
4
Followers