Infrastructure SRE - HPC

About the role

Sarvam runs a large, multi-vendor GPU fleet that serves two demanding workloads on the same physical infrastructure: training jobs that span hundreds of GPUs and must run uninterrupted for weeks, and inference services that must hold a flat p99 under production load. This is not a Kubernetes administration role.

What you'll do

• Operate the GPU fleet end to end across training and serving - provisioning, observability, capacity, and fleet health
• Hold a meaningful on-call rotation, write runbooks that hold up under pressure, and drive postmortems that produce durable fixes
• Build the internal tooling the team relies on, rather than operating off-the-shelf systems alone
• Partner with ML and platform teams to keep large runs alive and serving latency predictable

What you need

• Kubernetes
• Python
• Networking
• Go
• Machine learning
• Any graduate