ML Systems Performance Engineer

About the role

Engineers on the inference performance team operate at the intersection of hardware and software, driving end-to-end model inference speed and throughput. Their work spans low-level kernel performance debugging and optimization, system-level performance analysis, performance modeling and estimation, and the development of tooling for performance projection and diagnostics.

What you'll do

• Build performance models (kernel-level, end-to-end) to estimate the performance of state of the art and customer ML models
• Debug and understand runtime performance on the system and cluster
• Develop tools and infrastructure to help visualize performance data collected from the Wafer Scale Engine and our compute cluster

What you need

• 3–6 yrs of experience
• Machine learning
• Python
• Deep learning
• LLMs
• C++
• PhD or B.Tech or B.E. or M.Tech or MCA or M.Sc