Software Engineer - Model API Platform
BengaluruFull-time4–6 yrsPosted 3 weeks ago
Mid-level software engineering role at Sarvam in Bengaluru. Needs 4–6 years.
About the role
Sarvam's model APIs (ASR, TTS, Vision, LLM, Translate) are how developers and enterprises ship products on our foundation models. The platform handles tens of millions of API calls every day, over HTTP and WebSockets, with metering, billing, prepaid wallets and rate-limiting all part of the same stack.
What you'll do
- Own a platform area end to end
- Own one or more major parts of the platform, such as the WebSocket streaming layer, a speech recognition pipeline, or text to speech pipeline: build
- Turn loosely defined goals into RFCs, milestones and shipped results, and write down the decisions and trade-offs
- Make the call when a decision is needed, and own the outcome
- Obsessed with latencies, dissecting existing services to understand the system, and tuning the right knobs to optimize performance
What you need
- Python
- PostgreSQL
- Redis
- Go
- Kubernetes
- LLMs
Good to have
- CI/CD
- FastAPI
- Incident response
- Root cause analysis
- MLOps