Applied AI Engineer II

About the role

ACES CØDE is a Microsoft engineering organization focused on reducing operational demand across the Microsoft Cloud, including but not limited to the avoidable support cases, repeated troubleshooting, and manual interventions that arise when cloud products, platforms, or processes do not work as intended.

What you'll do

• Translate product specifications into AI service architectures — decompose business intent into agent workflows, data source integrations, and scalable service designs
• Develop and iterate on LLM-based solutions including prompt engineering, model selection, cost/token optimization, and RAG pipeline design
• Build evaluation systems including rubrics, golden datasets, and judge agents to validate agent correctness and safety before production deployment
• Write production-quality C# and Python with test-driven development, ensuring services meet reliability, performance, and security standards
• Deploy services using CI/CD pipelines, feature flags, and staged rollouts with full production observability (tracing, logging, metrics)

What you need

• 3–6 yrs of experience
• Python
• LLMs
• Prompt engineering
• Azure
• C#
• CI/CD
• B.Sc or B.Tech or B.E. or BCA or M.Sc or M.Tech or MCA

Good to have

• Microservices
• Data structures
• Test automation
• System design
• Incident response
• C