Data Engineer - Consultant
RemoteFull-timeFresherPosted 3 months ago
Entry-level data science role at Rubick.AI. Open to freshers. Remote.
About the role
You will be responsible for building and maintaining Rubick's data acquisition engine by extracting, validating, and structuring product information from eCommerce websites and marketplaces. This role focuses on developing scalable web crawling solutions that power Product Discovery, Search, Catalog Intelligence, and Market Intelligence platforms.
What you'll do
- Develop, maintain, and optimize web crawlers to extract product data from eCommerce websites and marketplaces
- Collect structured and unstructured product information, including product details, pricing, images, specifications, and availability
- Clean, validate, and organize extracted datasets to ensure accuracy and consistency
- Monitor crawler performance, identify failures, and resolve data extraction issues
- Collaborate with Product, Engineering, and Data teams to ensure reliable and timely data collection
What you need
- Machine learning
- Python
- ETL
- HTML
- CSS
- REST APIs
Good to have
- JavaScript
- Selenium
- Playwright