AI Quality Engineer, Safety and RAG - Assistant Vice President

About the role

We are seeking a highly motivated and experienced AI Quality Engineer to join our Retail and Wealth Risk Engineering team under the Enterprise Risk Technology platform. This role spans the full spectrum of modern AI quality engineering — from Agentic AI flow testing and RAG pipeline validation to AI safety, test automation , and performance & reliability engineering .

What you'll do

• Design and execute end-to-end test strategies for Agentic AI pipelines , including single-agent and multi-agent workflows
• Validate agent reasoning, planning, and decision-making chains (e.g., ReAct, Chain-of-Thought, Plan-and-Execute, Reflexion)
• Test tool-use correctness — ensuring agents invoke the right tools, with correct parameters, at the right time
• Evaluate agent memory systems (short-term, long-term, episodic) for accuracy and context retention across sessions
• Test termination conditions , loop detection, and infinite loop prevention in autonomous agent loops

What you need

• 8–14 yrs of experience
• Machine learning
• Performance testing
• LLMs
• Test automation
• Data privacy
• Regression testing
• B.Tech or B.E. or B.Sc or BCA

Good to have

• CI/CD
• OWASP
• Vulnerability assessment
• MLOps