Senior System Software Engineer - Local AI
PuneFull-time5–9 yrsPosted 2 weeks ago
Senior software engineering role at Nvidia in Pune. Needs 5+ years and a B.Tech, B.E. or B.Sc.
About the role
The Local AI Inference team is seeking a Senior System Software Engineer to lead the development of robust system-level software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models across Linux and Windows systems powered by RTX and DGX-class GPUs.
What you'll do
- Partner across organizations with benchmarking teams, inference teams, and AI application developers to define requirements, design
- Build Git-based CI infrastructure for automated builds, integration testing, and regression detection across hardware platforms, operating systems
- Develop model management services to download, version, cache, and synchronize checkpoints and dependencies for reproducible execution
- Design databases, backend services, and data pipelines to store and query model metadata, benchmark results, system telemetry, and execution artifacts
- Create dashboards and reports that help engineers compare inference configurations, identify regressions, and investigate performance bottlenecks
What you need
- Git
- SQL
- Python
- C++
- C#
- ETL
Good to have
- Grafana
- Data modelling
- PyTorch
- Instrumentation
- C
- Deep learning