Senior AI Evaluation & Reliability Engineer

About the role

We are looking for a Senior AI Evaluation & Reliability Engineer who is passionate about solving one of the most important challenges in AI: How do we know an AI system is actually working, improving, and delivering business value? You will design and build production-grade evaluation systems for LLMs, RAG applications, and multi-agent systems, while helping enterprise clients and our engineering teams adopt AI with confidence.

What you'll do

• Make AI Performance & ROI Measurable Build evaluation strategies that connect AI performance to business outcomes and ROI
• Define quality benchmarks, SLOs, risk thresholds, and success criteria
• Track hallucinations, reliability issues, and production risks
• Build executive-friendly AI quality and ROI scorecards
• Help clients determine where AI should be autonomous, supervised, or avoided

What you need

• 8–10 yrs of experience
• LLMs
• Python
• CI/CD
• Test automation
• TypeScript
• Any graduate

What you get

• ₹30 L–₹35 L a year