Backend Solution Engineer - SDE II

About the role

We're looking for a strong backend and systems engineer who has hands-on exposure with AI. Engineering comes first and AI second. You'll design, build and own production systems that combine core engineering, streaming audio, LLMs and agents, and you'll run them at scale. You'll own features from design doc to production to on-call, and you'll ship fast without breaking things.

What you'll do

• Architect and build on EkaScribe's pipeline: streaming audio intake, ASR, transcript processing, LLM-based document generation
• Own reliability end to end: SLOs, fallbacks across model providers, retries, idempotency, backpressure, graceful degradation, incident response and postmortems
• Build evals and observability for LLM systems: offline eval suites, online quality signals, hallucination and omission tracking
• Build agentic systems: tool-using agents, multi-step orchestration, memory and retrieval, and guardrails that keep agents grounded in what was actually said and recorded
• Design for scale and optimised solutions: queue-based async processing, caching, batching, token and GPU cost budgets, and multi-tenant isolation

What you need

• 4–6 yrs of experience
• System design
• Python
• AWS
• PostgreSQL
• Kubernetes
• Redis
• Any graduate

Good to have

• LLMs
• Data modelling
• Incident response