AI Inference Engineer QVAC (100% remote Worldwide)

About the role

You will own the inference backbone behind QVAC's local AI stack: the C++ systems layer that makes models run fast, reliably, and predictably on real user hardware. The role is centered on engineering quality at runtime level, including startup behavior, memory pressure, throughput/latency balance, and long-session stability.

What you'll do

• Work on deploying machine learning models to edge devices using the frameworks: llama.cpp, ggml
• Collaborate closely with researchers to assist in coding, training and transitioning models from research to production environments
• Integrate AI features into existing products, enriching them with the latest advancements in machine learning
• You know how to train/fine-tune a LLM
• You have productionized models

What you need

• Machine learning
• LLMs
• Deep learning
• C++
• JavaScript
• Lean
• B.Tech or B.E. or B.Sc or BCA