Senior Technical Architect

About the role

The LLMOps Engineer is responsible for operationalizing, scaling, monitoring, and governing Large Language Model (LLM)–based systems in production. This role focuses on ensuring LLM applications are reliable, performant, cost-efficient, observable, and secure across their lifecycle—from deployment to continuous optimization.

What you'll do

• Deploy and manage LLM-based applications across cloud and hybrid environments
• Build and maintain production-grade inference pipelines for LLM workloads
• Design and implement LLMOps pipelines for model, prompt, and configuration lifecycle management
• Implement monitoring for latency, throughput, cost, errors, drift, and hallucinations
• Build dashboards and alerts to ensure SLA and reliability targets

What you need

• 6–10 yrs of experience
• Python
• AWS
• Docker
• Kubernetes
• LLMs
• Machine learning
• Any graduate

Good to have

• GCP
• CI/CD
• MLOps
• Azure