Software Engineer - Model API Platform

About the role

Sarvam's model APIs (ASR, TTS, Vision, LLM, Translate) are how developers and enterprises ship products on our foundation models. The platform handles tens of millions of API calls every day, over HTTP and WebSockets, with metering, billing, prepaid wallets and rate-limiting all part of the same stack.

What you'll do

• Own a platform area end to end
• Own one or more major parts of the platform, such as the WebSocket streaming layer, a speech recognition pipeline, or text to speech pipeline: build
• Turn loosely defined goals into RFCs, milestones and shipped results, and write down the decisions and trade-offs
• Make the call when a decision is needed, and own the outcome
• Obsessed with latencies, dissecting existing services to understand the system, and tuning the right knobs to optimize performance

What you need

• 4–6 years in software engineering
• Python
• PostgreSQL
• Redis
• Go
• Kubernetes
• LLMs
• Any graduate

Good to have

• CI/CD
• FastAPI
• Incident response
• Root cause analysis
• MLOps