Senior Software Development Test Engineer - AI

About the role

We are looking for highly motivated Senior AI Software Development Engineers in Test (AISDET) to join Tekion’s ML Engineering team. models and AI agents that power the Automotive Retail Cloud (ARC) — from Service AI Agents and F&I automation to the AI-powered Analytics Agent — trained on real-time data spanning 1,700+ dealership rooftops.

What you'll do

• Own end-to-end quality for the ML models, AI agents, and AI-powered features shipped by the ML Engineering team
• Design and implement automated testing frameworks for model inference, prompt pipelines, agentic workflows, RAG/retrieval systems, and the APIs that serve them
• Validate model correctness, accuracy, latency, and behavioral consistency across model versions, prompt changes, and upgrades
• Creating and curating evaluation datasets (evals) and ground-truth sets
• Measuring response accuracy, relevance, and consistency

What you need

• 5–8 years in software engineering
• Machine learning
• LLMs
• Test automation
• Root cause analysis
• CI/CD
• Test cases
• Any graduate

Good to have

• Python
• Java
• AWS
• Docker
• Kubernetes
• MLOps