AI Test Engineer - VLabs
BengaluruFull-timeHybrid7–13 yrsPosted 5 days ago
Senior QA and testing role at Vialto Partners in Bengaluru. Needs 7+ years and a B.Tech, B.E. or B.Sc. Hybrid.
About the role
AI Test Engineering is a hands-on role within VLabs Quality Engineering, responsible for validating the performance, reliability, and integrity of AI-enabled solutions in production environments. This role operates at the intersection of AI engineering and quality assurance, ensuring that outputs from LLMs, OCR pipelines, document classification models, and agentic workflows perform as expected at scale and meet defined business performance thresholds.
What you'll do
- AI Evaluation & Test Design
- Translate AI testing strategy into executable test scenarios across LLM outputs, document classification, extraction accuracy, agent workflows, and edge cases
- Design adversarial and boundary test inputs to expose hallucination, misclassification, and failure modes
- Validate AI outputs for structure, consistency, accuracy, and production readiness against defined performance thresholds
- Evaluation Engineering & Automation
What you need
- API testing
- Python
- SQL
- Postman
- LLMs
- Test cases
Good to have
- AWS
- Azure
- Machine learning
- CI/CD
- Data privacy