SDE2 - API Platform

About the role

Sarvam's model APIs (LLM, ASR, TTS, Vision, Translate) are how developers and enterprises ship products on our foundation models. Today it's FastAPI and Python; we're in the middle of rewriting it in Go. We're hiring a Software Engineer (SDE 2) to own core parts of this platform.

What you'll do

• Building and evolving the LLM API platform, from the moment a request hits the edge to the response that goes back out
• The Python→Go rewrite: building services in Go alongside the existing Python stack, without compromising reliability
• Performance and reliability for a multi-tenant platform serving long-context agentic and coding workloads
• Close partnership with the Inference and MLOps teams on production readiness for new model launches
• Design-first, documentation-first engineering culture within the team: RFCs before code, decisions written down, no tribal knowledge

What you need

• Kubernetes
• Python
• Go
• FastAPI
• PostgreSQL
• Root cause analysis

Good to have

• Redis
• LLMs
• Performance testing
• MLOps