AI Engineer

About the role

Certa (certa.ai http://certa.ai) is an AI-native third-party risk management platform that unifies the full third-party lifecycle, from onboarding through continuous monitoring and offboarding. The model is the same one everyone can buy - the harness is what makes ours do the job reliably, safely, and cheaply, and you’ll own that harness.

What you'll do

• Own the agent loop: Step control, planning, retries, error feedback, subagents, and parallel tool calls for long, multi-step tasks
• Design tools & actions: Build the tools, MCP servers, and skills our agents use - narrow, well-described, permissioned, and safe to call against customer data
• Build evals that gate every change: Golden sets, regression suites, and trace-based scoring wired into CI, so no prompt, model, or harness change ships blind
• Own model choices & the runtime: Route across models on capability, latency, and cost
• Own the backend systems: Design services end to end (data model, APIs, storage choice, failure modes), build async pipelines (queues, workers, retries, idempotency

What you need

• 3–6 years in data science & ai
• LLMs
• AWS
• Any graduate

Good to have

• Python
• System design