Software Development Engineer in Test - AI
RemoteFull-timeJunior levelPosted 4 days ago
QA and testing role at Jobgether. Needs an M.Sc, B.Tech or B.E.. Remote.
About the role
We are looking for a forward-thinking Software Development Engineer in Test specializing in AI to drive quality, reliability, and innovation across AI-powered applications and intelligent systems. In this role, you will go beyond traditional software testing by designing advanced evaluation frameworks for LLMs, AI agents, copilots, and RAG-based applications.
What you'll do
- Create synthetic and benchmark datasets to validate different AI scenarios
- Test MCP (Model Context Protocol) integrations and interoperability
- Prompt and Context Engineering: Contribute to prompt engineering, context engineering, and prompt optimization strategies to improve AI response quality, reliability
- Performance and Cost Optimization: Evaluate AI application latency, token consumption, throughput, scalability
- Build reusable testing libraries, utilities, and AI-assisted testing workflows
What you need
- API testing
- Test automation
- Python
- SQL
- LLMs
- Machine learning
Good to have
- Performance testing
- MLOps
- Prototyping
- CI/CD
- Azure
- Prompt engineering