Staff Backend Engineer - K8 (Envoy)

Coupang Internal·Bengaluru

Pay not stated8–14 yrsFull-timeHybrid

Apply on Coupang Internal's site Track your applications and see your fit: start free

Read from the company's own careers page; you apply on their site.

How well do you fit this job?

Upload your resume to see each requirement checked against your profile, in under a minute.

Check my fit

Hard to read?

About the role

As a Staff Backend Engineer, you will work closely with platform and product leaders to design and deliver solutions for complex infrastructure problems. You will drive the development of highly scalable, reliable, and efficient platform services while providing technical direction across teams working with Java, AWS, Kafka, Kubernetes, Kubeflow, Argo CD, and gRPC.

What you'll do

Design and develop high-performance request routing, model endpoint abstraction, traffic shaping, load balancing, failover, caching
Drive the technical vision and roadmap for scalable, secure, and reliable AI inference infrastructure across cloud and on-prem environments
Develop critical infrastructure components in Go, Java, or Python with a strong focus on performance, resiliency, and operational excellence
Design multi-tenant platform capabilities including authentication, authorization, quota management, cost attribution, rate limiting, and governance controls
Partner closely with ML Platform, Model Serving, Data, and Product Engineering teams to enable seamless deployment and operation of AI workloads