AI Test Engineer - VLabs

About the role

AI Test Engineering is a hands-on role within VLabs Quality Engineering, responsible for validating the performance, reliability, and integrity of AI-enabled solutions in production environments. This role operates at the intersection of AI engineering and quality assurance, ensuring that outputs from LLMs, OCR pipelines, document classification models, and agentic workflows perform as expected at scale and meet defined business performance thresholds.

What you'll do

• AI Evaluation & Test Design
• Translate AI testing strategy into executable test scenarios across LLM outputs, document classification, extraction accuracy, agent workflows, and edge cases
• Design adversarial and boundary test inputs to expose hallucination, misclassification, and failure modes
• Validate AI outputs for structure, consistency, accuracy, and production readiness against defined performance thresholds
• Evaluation Engineering & Automation

What you need

• 7–13 yrs of experience
• API testing
• Python
• SQL
• Postman
• LLMs
• Test cases
• B.Tech or B.E. or B.Sc or BCA

Good to have

• AWS
• Azure
• Machine learning
• CI/CD
• Data privacy