Member of Technical Staff, ML Inference Engineering

About the role

It's one of the most demanding environments in the industry: strict latency budgets, massive concurrency, and infrastructure that needs to be private and reliable. We're looking for a deeply hands-on, experienced engineer to help lead that build. This is someone who shapes core infrastructure and architecture decisions rather than just executing against a specification, and who naturally raises the level of the engineers working alongside them.

What you'll do

• Implement custom kernels and low-level optimizations to push the absolute limits of GPU compute
• Apply graph optimization, operator fusion, and hardware-specific code generation at the ML compiler level
• Profile, analyze, and resolve deep system bottlenecks to radically improve latency, throughput, and memory efficiency
• Drive model-level execution improvements, including mixed precision and advanced quantization strategies
• Write and optimize custom inference server backends to handle complex business logic, scripting, and state management

What you need

• 8–14 yrs of experience
• Machine learning
• Python
• C++
• C
• Rust
• Firewalls
• Any graduate

Good to have

• Kubernetes
• LLMs
• Roadmapping