Staff Site Reliability Engineer

About the role

We're looking for a Staff Site Reliability Engineer who is equally at home writing production software and running the infrastructure it lives on — and who wants to take ownership of one of the hardest, highest-leverage problems on our platform: intelligently managing a large fleet of GPU-backed models.

What you'll do

• Design and build our GPU management and scheduling platform — the system that decides when, where
• Build the metrics pipeline that collects GPU load and utilization data, and the logic that turns those signals into decisions
• Implement admission control to protect capacity — deciding when to accept, queue, or shed inference requests so we operate within fleet limits
• Build autoscaling that adjusts the number of model replicas in response to real-time demand and utilization
• Develop cloud orchestration systems and operators in Python and Go to manage the model fleet

What you need

• 10–18 yrs of experience
• AWS
• CI/CD
• Terraform
• Kubernetes
• Docker
• Azure
• B.Tech or B.E. or M.Sc or B.Sc or BCA or M.Tech or MCA

Good to have

• Machine learning
• LLMs
• Valuation
• GCP
• Python
• Grafana