SDET 3 - Model Evaluation

About the role

We are looking for a dedicated ML Model Evals & Benchmarking Engineer to bridge the gap between machine learning research and high-performance production systems.

What you'll do

• Own model quality before production: Establish standard evaluation frameworks using statistical metrics (e.g., Precision, Recall, F1-Score
• Build validation frameworks for computer vision models (preferably satellite or geospatial)
• Catch regressions in statistical metrics before they reach customers
• Build version-aware model regression: Set up pipelines that compare inference outputs across model versions on curated golden datasets. Every release should come with a…
• Make data quality a first-class gate: Validate training and evaluation datasets for label quality, class balance, geographic and seasonal coverage, leakage, and drift

What you need

• 8–10 yrs of experience
• Performance testing
• Python
• Test automation
• SQL
• Machine learning
• MLOps
• Any graduate

Good to have

• Computer vision
• CI/CD
• AWS
• ETL
• Root cause analysis
• System design