Sr Data Engineer, Data AI Analytics
GurugramFull-time4–7 yrsPosted 1 week ago
Mid-level data science role at McCain Foods in Gurugram. Needs 4+ years and an M.Sc, B.Tech or B.E..
About the role
Data engineers are mainly responsible for designing, building, managing, and operationalizing data pipelines to support key data and analytics use cases. They play a crucial role in constructing and maintaining a modern, scalable data platform that utilizes the full capabilities of a Lakehouse Platform.
What you'll do
- Build and maintain scalable data pipelines and workflows within the Lakehouse environment
- Transform, cleanse, and aggregate data using Spark SQL or PySpark
- Optimize Spark jobs for performance, cost efficiency, and reliability
- Develop and manage Lakehouse tables for efficient data storage and versioning
- Utilize notebooks for interactive data exploration, analysis, and development
What you need
- Analytics
- Machine learning
- ETL
- Data warehousing
- Python
- Data modelling
Good to have
- R
- Data structures
- Power BI
- Data privacy
- Spark
- Tableau