Senior System Software Engineer - Local AI Automation
PuneFull-time5–9 yrsPosted 3 weeks ago
Senior software engineering role at Nvidia in Pune. Needs 5+ years and a B.Tech, B.E. or B.Sc.
About the role
The Local AI Automation team is seeking a Senior System Software Engineer passionate about building and maintaining robust system-level software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models. You will collaborate with a team of highly qualified engineers dedicated to creating top-tier infrastructure for Local AI automation.
What you'll do
- Design, implement, and maintain robust system software and infrastructure to efficiently run various AI workloads through different inference backends such as Llama.cpp
- Scope out system requirements for deploying various AI applications, benchmarks, and models in automation, and develop solutions to measure correctness, functionality
- Develop infrastructure to download AI models from various sources, efficiently manage a local model repository
- Analyze large datasets and system workload metrics, implement data processing infrastructure to transform raw data into actionable information for developers
- Collaborate with internal Local AI developers to identify and implement system-level instrumentation, diagnostics
What you need
- SQL
- Git
- Java
- Python
- C++
- C#
Good to have
- Kubernetes
- Docker
- Linux
- Grafana
- CI/CD
- PyTorch