Performance Engineer, Inference
Bengaluru, ChennaiFull-timeJunior levelPosted 2 months ago
Engineering role at Sarvam in Bengaluru and Chennai.
About the role
The Performance Engineering team owns the numbers the rest of the company plans against: how fast we serve, how much it costs, and how much we get out of every GPU. This team works at the intersection of the serving runtime, the kernel layer, and the SRE org that keeps the fleet alive. You will own Sarvam's production serving path for large distributed models end to end.
What you need
- C++
- LLMs
- Machine learning
- Wiring