Senior System Software Engineer - Local AI

About the role

The Local AI Inference team is seeking a Senior System Software Engineer to lead the development of robust system-level software and infrastructure for deploying, benchmarking, and qualifying high-quality AI applications and models across Linux and Windows systems powered by RTX and DGX-class GPUs.

What you'll do

• Partner across organizations with benchmarking teams, inference teams, and AI application developers to define requirements, design
• Build Git-based CI infrastructure for automated builds, integration testing, and regression detection across hardware platforms, operating systems
• Develop model management services to download, version, cache, and synchronize checkpoints and dependencies for reproducible execution
• Design databases, backend services, and data pipelines to store and query model metadata, benchmark results, system telemetry, and execution artifacts
• Create dashboards and reports that help engineers compare inference configurations, identify regressions, and investigate performance bottlenecks

What you need

• 5–9 years in software engineering
• Git
• SQL
• Python
• C++
• C#
• ETL
• B.Tech or B.E. or B.Sc or BCA

Good to have

• Grafana
• Data modelling
• PyTorch
• Instrumentation
• C
• Deep learning

What you get