Staff Software Development Test Engineer

About the role

Staff Software Development Test Engineer at Tekion. Generative AI & LLM Evaluation.

What you'll do

• Generative AI & LLM Evaluation
• Build automated testing suites to detect hallucinations, bias, toxicity, and prompt injection vulnerabilities across LLM-powered products
• Implement automated evaluations for RAG systems measuring context relevance, groundedness, and answer faithfulness using frameworks like RAGAS or DeepEval
• Design test beds to validate multi-agent workflows — tool-calling accuracy, multi-step reasoning, memory, and autonomous decision loops
• Build and run automated conversation simulations — scripted and synthetic user journeys — to stress-test agent behaviour across intents, edge cases

What you need

• 8–14 years in software engineering
• SQL
• Python
• Unit testing
• Docker
• LLMs
• CI/CD
• Any graduate

Good to have

• AWS
• Kubernetes
• Performance testing
• Terraform
• GCP
• Test cases