Data Engineer - Consultant

About the role

You will be responsible for building and maintaining Rubick's data acquisition engine by extracting, validating, and structuring product information from eCommerce websites and marketplaces. This role focuses on developing scalable web crawling solutions that power Product Discovery, Search, Catalog Intelligence, and Market Intelligence platforms.

What you'll do

• Develop, maintain, and optimize web crawlers to extract product data from eCommerce websites and marketplaces
• Collect structured and unstructured product information, including product details, pricing, images, specifications, and availability
• Clean, validate, and organize extracted datasets to ensure accuracy and consistency
• Monitor crawler performance, identify failures, and resolve data extraction issues
• Collaborate with Product, Engineering, and Data teams to ensure reliable and timely data collection

What you need

• Open to freshers
• Machine learning
• Python
• ETL
• HTML
• CSS
• REST APIs
• Any graduate

Good to have

• JavaScript
• Selenium
• Playwright