Staff Engineer, API Platform

About the role

Sarvam's model APIs (ASR, TTS, Vision, LLM, Translate) are how developers and enterprises ship products on our foundation models. The platform handles tens of millions of API calls every day, over HTTP and WebSockets, with metering, billing, prepaid wallets, and rate-limiting all part of the same stack.

What you'll do

• The end-to-end design and evolution of the platform, from the moment a request hits the edge to the response that goes back out
• The Python→Go rewrite: leading the architecture, setting the patterns, and bringing the platform across without compromising reliability
• Performance and reliability for a multi-tenant platform operating at sub-second latency SLOs
• Integration testing infrastructure: the harness that lets us ship fast without breaking customer-facing APIs
• Close partnership with the Inference and MLOps teams, mentoring them on production engineering so model serving is fast, reliable, and operable

What you need

• Python
• PostgreSQL
• Redis
• Kubernetes
• FastAPI
• Go

Good to have

• LLMs
• MLOps