Software Engineering Manager, AI/ML Infrastructure and Performance Engineering
BengaluruFull-time8–14 yrsPosted over a month ago
Leadership data science role at Google in Bengaluru. Needs 8+ years and a degree.
About the role
Like Google's own ambitions, the work of a Software Engineer goes beyond just Search. Software Engineering Managers have not only the technical expertise to take on and provide technical leadership to major projects, but also manage a team of Engineers. You not only optimize your own code but make sure Engineers are able to optimize theirs.
What you'll do
- Support new and exciting ML paradigms (such as horizontal scaling for upcoming TPU chips) by making contributions across the end to end stack and analysis tools
- Partner with ML Stack leads to understand model optimization use cases and bring debugging to feel native in 3P environments (VSCode, Cursor, Grafana, etc)
- Work with OSS ML inference frameworks such as vLLM, SGLang to provide insights in Xprof about performance improvement opportunities
- Partner with other teams that own various parts of the ML stack to understand performance optimization use cases
- Work with OSS ML inference frameworks such as TorchTPU, vLLM, SGLang to provide insights into performance bottlenecks
What you need
- Machine learning
- NLP
- Grafana
- Product strategy
- System design
Good to have
- TensorFlow
- PyTorch