Senior System Software Engineer - Local AI
PuneFull-time5–9 yrsPosted over a month ago
Senior software engineering role at Nvidia in Pune. Needs 5+ years and a PhD, B.Tech or B.E..
About the role
Build and optimize the local AI inference stack for RTX, RTX Pro, and DGX GPUs, with a focus on performance, stability, and scalability across diverse hardware architectures. Proven experience architecting and optimizing AI inference pipelines and applications using ML/DL frameworks such as Llama.cpp, vLLM, PyTorch, Windows ML, DXCGC, and TensorRT.
What you'll do
- Build and optimize the local AI inference stack for RTX, RTX Pro, and DGX GPUs, with a focus on performance, stability
What you need
- Data structures
- C++
- Machine learning
- Deep learning
- PyTorch