Quality Engineer 2 ( Python , Automation )

About the role

The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems.

What you'll do

• Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD…
• Review testing strategies, approaches, and test plans and provide insight to development teams
• Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.)
• Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection
• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability

What you need

• 3–6 yrs of experience
• Python
• Microservices
• Unit testing
• AWS
• LLMs
• CI/CD
• Any graduate

Good to have

• Test cases
• Performance testing
• Machine learning
• Regression testing
• API testing
• GCP