Software Development Engineer in Test - AI

About the role

We are looking for a forward-thinking Software Development Engineer in Test specializing in AI to drive quality, reliability, and innovation across AI-powered applications and intelligent systems. In this role, you will go beyond traditional software testing by designing advanced evaluation frameworks for LLMs, AI agents, copilots, and RAG-based applications.

What you'll do

• Create synthetic and benchmark datasets to validate different AI scenarios
• Test MCP (Model Context Protocol) integrations and interoperability
• Prompt and Context Engineering: Contribute to prompt engineering, context engineering, and prompt optimization strategies to improve AI response quality, reliability
• Performance and Cost Optimization: Evaluate AI application latency, token consumption, throughput, scalability
• Build reusable testing libraries, utilities, and AI-assisted testing workflows

What you need

• 1–3 years in quality assurance & testing
• API testing
• Test automation
• Python
• SQL
• LLMs
• Machine learning
• M.Sc or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA

Good to have

• Performance testing
• MLOps
• Prototyping
• CI/CD
• Azure
• Prompt engineering