Senior Software Engineer, ML Compiler, Frameworks and Performance

About the role

Google Cloud's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another.

What you'll do

• Identify opportunities to improve the efficiency of the ML workloads through insightful performance debugging for workloads and custom kernels and build solutions to…
• Partner with other teams that own various parts of the ML stack to understand performance optimization use cases
• Work with OSS ML inference frameworks such as TorchTPU, vLLM, SGLang to provide insights into performance bottlenecks
• Support new and exciting ML paradigms (such as horizontal scaling for upcoming TPU chips) by making contributions across the stack and performance analysis tools
• If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form

What you need

• 5–9 yrs of experience
• Machine learning
• Python
• C++
• System design
• GCP
• PyTorch
• Any graduate

Good to have

• TensorFlow
• NLP