Backend / ML-Ops Engineer — Speech Model Deployment & Inference Optimization

About the role

AI-Enabled Nursing Services – a hybrid care delivery model where AI and licensed nurses work together to deliver virtual triage, remote patient monitoring, and specialty patient support programs (e.g., oncology, dementia, dialysis). All models operate within a HIPAA-compliant and SOC 2–certified framework.

What you'll do

• Containerize and deploy speech models using Triton Inference Server with TensorRT/FP16 optimizations
• Develop and manage CI/CD pipelines for model promotion (staging → production)
• Configure autoscaling on Kubernetes (GPU pools) based on active calls or streaming sessions
• Build health and observability dashboards : latency, token delay, WER drift, SNR/packet loss monitors
• Integrate LM bias APIs, failover logic, and model switchers for fallback to larger/cloud models

What you need

• 4–6 yrs of experience
• MLOps
• LLMs
• Kubernetes
• CI/CD
• B.Tech or B.E. or M.Tech

Good to have

• Python
• AWS
• GCP
• Docker
• Bash
• Azure