Infrastructure SRE - HPC
Bengaluru, ChennaiFull-timeJunior levelPosted 4 months ago
DevOps and cloud role at Sarvam in Bengaluru and Chennai.
About the role
Sarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs and must run uninterrupted for weeks, and inference services that must hold a flat p99 under production load. This is not a Kubernetes administration role.
What you'll do
- Operate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health
- Hold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes
- Build the internal tooling the team relies on, rather than operating off-the-shelf systems alone
- Partner with ML and platform teams to keep large runs alive and serving latency predictable
What you need
- Kubernetes
- Python
- Networking
- Go
- Machine learning