Software Engineering Manager, AI/ML Infrastructure and Performance Engineering

About the role

Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs.

What you'll do

• Support new and exciting ML paradigms (such as horizontal scaling for upcoming TPU chips) by making contributions across the end to end stack and analysis tools
• Partner with ML Stack leads to understand model optimization use cases and bring debugging to feel native in 3P environments (VSCode, Cursor, Grafana, etc)
• Work with OSS ML inference frameworks such as vLLM, SGLang to provide insights in Xprof about performance improvement opportunities
• Partner with other teams that own various parts of the ML stack to understand performance optimization use cases
• Work with OSS ML inference frameworks such as TorchTPU, vLLM, SGLang to provide insights into performance bottlenecks

What you need

• 8–14 yrs of experience
• Machine learning
• NLP
• Grafana
• Product strategy
• System design
• Any graduate

Good to have

• TensorFlow
• PyTorch