Lead AI Engineer

About the role

You will join a small AI team that owns the Copilot end to end: the agentic orchestration graph, retrieval and grounding, safety guardrails, response contracts with the frontend, and the evaluation platform that keeps it honest. This is a senior role with a visible leadership runway.

What you'll do

• Design, build, and operate agentic LLM workflows in LangGraph — routing, planning, parallel retrieval, tool execution, verification
• Own RAG quality : multi-source retrieval across vector stores (Milvus, pgvector), a knowledge graph (Neo4j), and structured platform data; chunking strategy; reranking
• Build and extend our evaluation platform : online LLM-as-judge evaluators, offline regression suites on curated datasets (LangSmith), latency baselines
• Drive latency and cost optimization : model selection across providers (OpenAI, Gemini, open-weight models via OpenRouter), prompt and context engineering
• Instrument and debug production behavior with LangSmith tracing, OpenTelemetry, New Relic, and Sentry ; treat live-QA findings as first-class inputs to design

What you need

• 4–8 yrs of experience
• Python
• LLMs
• PostgreSQL
• Next.js
• Django
• Prototyping
• Any graduate

Good to have

• Machine learning
• Scikit-learn
• BigQuery
• PyTorch
• Spark
• Kafka