Sr. Software Dev Engineer, Alexa LLM Inference, Capacity, & Efficiency

About the role

If so, the Alexa LLM Inference, Capacity, & Efficiency (ALICE) team is looking for a Senior Software Development Engineer to join our new India team and own critical components of Alexa's LLM inference infrastructure. Alexa is shaping the future of AI voice-based personal assistants.

What you'll do

• As a Senior SDE, you will be part of the technical leadership for the India team
• Serve as a technical leader for the ALICE India team, driving architecture decisions for the AlexaLLMInferenceService (LLMI) and related ALICE portfolio services
• Design and implement scalable, high-availability systems for LLM inference serving, including multi-node distributed inference and multi-tenancy capabilities
• Lead technical design reviews, set coding standards, and mentor junior SDEs on the team
• Make technical trade-offs between short-term team needs and long-term business needs, with a focus on performance, cost, and reliability

What you need

• 6–11 yrs of experience
• LLMs
• Java
• C++
• C#
• Incident response
• B.Sc or B.Tech or B.E. or BCA