Staff Software Engineer-AI

About the role

We are looking for a Staff Software Engineer to serve as a technical leader within our Feedback Systems team, driving the architecture for the massive-scale infrastructure that simulates, tests, and evaluates AI agents. As an IC5 Staff Engineer, you will define the architectural vision for systems that simulate multi-agent, multi-turn deployments complete with tool integration.

What you'll do

• Simulation Architecture & Orchestration: Leading the end-to-end design and implementation of multi-agent, multi-turn simulation environments
• Architect systems where synthetic users and AI agents interact dynamically, leverage tools, and execute complex workflows to test boundary conditions
• "What-If" Evaluation Frameworks: Building the core methodology and scoring infrastructure that allows customers to run alternative configuration scenarios
• Behavioral Modeling & Persona Synthesis: Background in processing natural language data (e.g., historical user chat logs
• Evaluation & "What-If" Benchmarking: Solid experience building evaluation frameworks for non-deterministic AI systems, including establishing metrics, guardrails

What you need

• 10–18 yrs of experience
• System design
• Python
• Go
• LLMs
• Machine learning
• Regression testing
• Any graduate

Good to have

• ETL
• gRPC
• Customer success
• Compensation and benefits