Senior / Staff Software Engineer (AI Platforms)

About the role

We are looking for experienced, hands-on engineers who enjoy solving difficult technical problems and building complex software systems. You will take ownership of significant platform capabilities, make technical decisions, and work with engineers across Arm to develop new infrastructure from the ground up.

What you'll do

• Design and implement distributed infrastructure for AI inference, including model serving, request routing, workload scheduling, and resource management
• Build reliable, high-performance software, solving problems involving concurrency, networking, scalability, data consistency, and failure recovery
• Own software capabilities end to end, from evaluating design options and writing code to testing, deployment, debugging, and ongoing improvements
• Investigate system bottlenecks through profiling, benchmarking, and diagnostics. Improve latency, throughput, resource efficiency, and reliability
• Use and extend AI-assisted development tools and agentic workflows to improve engineering productivity, with appropriate testing, verification, and code review

What you need

• Data structures
• Python
• C++
• Go
• Kubernetes
• LLMs

Good to have

• Machine learning
• Test automation
• CI/CD
• Rust
• Linux