Staff Backend Engineer - K8 (Envoy)

About the role

As a Staff Backend Engineer, you will work closely with platform and product leaders to design and deliver solutions for complex infrastructure problems. You will drive the development of highly scalable, reliable, and efficient platform services while providing technical direction across teams working with Java, AWS, Kafka, Kubernetes, Kubeflow, Argo CD, and gRPC.

What you'll do

• Design and develop high-performance request routing, model endpoint abstraction, traffic shaping, load balancing, failover, caching
• Drive the technical vision and roadmap for scalable, secure, and reliable AI inference infrastructure across cloud and on-prem environments
• Develop critical infrastructure components in Go, Java, or Python with a strong focus on performance, resiliency, and operational excellence
• Design multi-tenant platform capabilities including authentication, authorization, quota management, cost attribution, rate limiting, and governance controls
• Partner closely with ML Platform, Model Serving, Data, and Product Engineering teams to enable seamless deployment and operation of AI workloads

What you need

• 8–14 yrs of experience
• Java
• Python
• Kubernetes
• AWS
• Go
• Microservices
• Any graduate

Good to have

• MongoDB
• Redis
• Cassandra
• GCP
• Azure
• Kafka