Senior System Software Engineer - Local AI

About the role

Build and optimize the local AI inference stack for RTX, RTX Pro, and DGX GPUs, with a focus on performance, stability, and scalability across diverse hardware architectures. Proven experience architecting and optimizing AI inference pipelines and applications using ML/DL frameworks such as Llama.cpp, vLLM, PyTorch, Windows ML, DXCGC, and TensorRT.

What you'll do

• Build and optimize the local AI inference stack for RTX, RTX Pro, and DGX GPUs, with a focus on performance, stability

What you need

• 5–9 yrs of experience
• Data structures
• C++
• Machine learning
• Deep learning
• PyTorch
• PhD or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA