Senior AI Evaluation & Reliability Engineer
AhmedabadFull-time8–10 yrs30 L–₹35 L a yearPosted 2 months ago
Senior AI role at Aubergine Solutions in Ahmedabad. Needs 8–10 years. Pays ₹30–35 LPA.
About the role
We are looking for a Senior AI Evaluation & Reliability Engineer who is passionate about solving one of the most important challenges in AI: How do we know an AI system is actually working, improving, and delivering business value? You will design and build production-grade evaluation systems for LLMs, RAG applications, and multi-agent systems, while helping enterprise clients and our engineering teams adopt AI with confidence.
What you'll do
- Make AI Performance & ROI Measurable Build evaluation strategies that connect AI performance to business outcomes and ROI
- Define quality benchmarks, SLOs, risk thresholds, and success criteria
- Track hallucinations, reliability issues, and production risks
- Build executive-friendly AI quality and ROI scorecards
- Help clients determine where AI should be autonomous, supervised, or avoided
What you need
- LLMs
- Python
- CI/CD
- Test automation
- TypeScript