Gen AI Consultant

About the role

We are seeking a GenAI Testing professional with experience in validating Large Language Models (LLMs), Agentic AI systems, RAG applications, and AI-powered business solutions. The candidate will drive quality assurance for GenAI implementations, ensuring accuracy, reliability, security, and business alignment of AI-generated outcomes.

What you'll do

• Design and execute test strategies for GenAI, RAG, Copilot, and Agentic AI applications
• Validate AI responses for accuracy, relevance, consistency, bias, toxicity, and hallucinations
• Develop AI-specific test scenarios, prompt libraries, and evaluation frameworks
• Create automated validation approaches for LLM outputs
• Perform prompt engineering and prompt optimization activities

What you need

• 6–10 yrs of experience
• Test automation
• Python
• LLMs
• Prompt engineering
• Azure
• API testing
• Any graduate

Good to have

• Git
• JIRA
• Test cases