Senior Software Engineer — Infra Agent Systems Remote India

About the role

Together AI runs one of the largest GPU fleets in the world. The Infra Agent Systems team builds the software systems that power and automate that infrastructure. We develop production AI agents that diagnose hardware failures, investigate incidents, correlate signals across the fleet, and automate operational workflows.

What you'll do

• Build the distributed services, orchestration framework, knowledge graph, and retrieval systems that power infrastructure agents
• Develop fleet intelligence systems that combine telemetry, infrastructure state, operational knowledge, and historical incidents to help agents make better decisions
• Integrate with observability, incident management, ticketing, fleet inventory, source control, chat, and internal infrastructure systems through well-designed APIs
• Own services end to end, including architecture, implementation, testing, deployment, observability, and production operations
• Improve agent performance through evaluations, retrieval improvements, better tools, and production feedback loops

What you need

• 5–9 yrs of experience
• TypeScript
• Python
• Kubernetes
• Go
• Kafka
• Data modelling
• Any graduate

Good to have

• LLMs
• Terraform
• Rust
• Prometheus
• Grafana