Senior Software Engineer, AI Infrastructure Solutions
PuneFull-time5–9 yrsPosted 2 days ago
Senior software engineering role at Nvidia in Pune. Needs 5+ years and a B.Tech, B.E. or B.Sc.
About the role
This is your opportunity to work on groundbreaking technologies and help build the future of computing! If you’re passionate about building scalable AI platforms and autonomous agent solutions that impact industries worldwide, we want to hear from you!
What you'll do
- Design, build, and operate AI infrastructure solutions that power LLM-based applications and autonomous agents across the enterprise
- Develop agentic AI workflows and multi-agent systems, including tool calling, planning, memory, retrieval-augmented generation (RAG)
- Integrate and serve LLMs through APIs and inference endpoints, optimizing for latency, throughput, cost, and reliability
- Containerize applications with Docker and deploy and scale them on Kubernetes, including Helm charts, autoscaling, and GPU-enabled workloads
- Take applications to L3 level: own production readiness, advanced troubleshooting, root-cause analysis, performance tuning
What you need
- REST APIs
- Python
- Git
- .NET
- Docker
- Kubernetes
Good to have
- C#
- LLMs
- CI/CD
- Root cause analysis
- Prompt engineering
- Helm