Software Development Engineer, AI Runtime
PuneFull-time3–6 yrsPosted 3 weeks ago
Mid-level software engineering role at Amazon in Pune. Needs 3+ years and a B.Tech, B.E. or B.Sc.
About the role
The AI Runtime team is the backbone of Alexa+. We own the infrastructure that powers Expert executions — the multi-agent systems that bring Alexa+'s intelligent capabilities to life for hundreds of millions of customers worldwide. When a customer interacts with Alexa+ and it feels magical, our platform made it happen.
What you'll do
- Design and implement Tier-1 distributed systems that orchestrate expert agent executions, manage LLM inference pipelines, and ensure reliable
- Design, build, and operate large-scale distributed services that power Alexa+ Expert executions
- Develop and optimize LLM orchestration pipelines — including model serving, prompt routing, and inference optimization
- Build multi-agent coordination systems that route requests to the right expert agents with minimal latency
- Own the operational excellence of Tier-1 services, ensuring 99.99%+ availability at scale
What you need
- LLMs
- Machine learning
Good to have
- System design