Tom Becker

Author

@tom

Networking & service mesh

Packets, proxies, and p99 latency for model gateways.

Austin, US tombeckerJoined Jul 7, 2026

Stories

377

Views

Likes

Followers

JanFebMarAprMayJunJul

10 contributions in the last 6 monthsLessMore

Routing, retries, and rate limits in front of your inference fleet.

Jun 161 min2897ML Inference

Latency budgets when 50ms of network is unacceptable.

May 131 min886ML Inference