Senior or Staff Software Engineer, Inference / Compute Infrastructure Engineering

About the role

We're looking for a software engineer to build the Kubernetes-native control plane that provisions and runs our GPU inference fleet.

What you'll do

• Build the provisioning state machine: design and implement the software that models the full lifecycle of a physical host from discovery
• Build the self-service API: design declarative APIs and a control plane so the inference team can request, scale
• Automate self-healing: detect degraded or failed nodes, drain them safely, trigger repair or replacement, and reintroduce healthy capacity into the pool automatically
• Own reliability of the pipeline: idempotency, retries, rollback, and drift detection so the provisioning system is as dependable as any other production service
• Partner with the inference/ML platform team: understand the cluster shapes they need — topology, interconnect

What you need

• Kubernetes
• Python
• Reconciliation
• CI/CD
• Go
• Rust
• Any graduate

Good to have

• Networking
• Kafka
• Ansible
• Machine learning