Lead AI Engineer
RemoteFull-time4–8 yrsPosted 1 week ago
Senior data science role at Bridge-it. Needs 4+ years. Remote.
About the role
You will join a small AI team that owns the Copilot end to end: the agentic orchestration graph, retrieval and grounding, safety guardrails, response contracts with the frontend, and the evaluation platform that keeps it honest. This is a senior role with a visible leadership runway.
What you'll do
- Design, build, and operate agentic LLM workflows in LangGraph — routing, planning, parallel retrieval, tool execution, verification
- Own RAG quality : multi-source retrieval across vector stores (Milvus, pgvector), a knowledge graph (Neo4j), and structured platform data; chunking strategy; reranking
- Build and extend our evaluation platform : online LLM-as-judge evaluators, offline regression suites on curated datasets (LangSmith), latency baselines
- Drive latency and cost optimization : model selection across providers (OpenAI, Gemini, open-weight models via OpenRouter), prompt and context engineering
- Instrument and debug production behavior with LangSmith tracing, OpenTelemetry, New Relic, and Sentry ; treat live-QA findings as first-class inputs to design
What you need
- Python
- LLMs
- PostgreSQL
- Next.js
- Django
- Prototyping
Good to have
- Machine learning
- Scikit-learn
- BigQuery
- PyTorch
- Spark
- Kafka