Staff Quality Engineer ( Python , AI )

About the role

With our employee Pack members, spread out globally, committed to setting new industry standards. The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection

What you'll do

• Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD…
• Review testing strategies, approaches, and test plans and provide insight to development teams
• Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.)
• Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency
• Hallucination detection, and regression testing for AI inference APIs

What you need

• 8–14 yrs of experience
• Python
• LLMs
• Microservices
• CI/CD
• Test cases
• Performance testing
• Any graduate

Good to have

• Machine learning
• Regression testing
• AWS
• GCP
• Azure