Sr Data Engineer, Data AI Analytics

About the role

Data engineers are mainly responsible for designing, building, managing, and operationalizing data pipelines to support key data and analytics use cases. They play a crucial role in constructing and maintaining a modern, scalable data platform that utilizes the full capabilities of a Lakehouse Platform.

What you'll do

• Build and maintain scalable data pipelines and workflows within the Lakehouse environment
• Transform, cleanse, and aggregate data using Spark SQL or PySpark
• Optimize Spark jobs for performance, cost efficiency, and reliability
• Develop and manage Lakehouse tables for efficient data storage and versioning
• Utilize notebooks for interactive data exploration, analysis, and development

What you need

• 4–7 yrs of experience
• Analytics
• Machine learning
• ETL
• Data warehousing
• Python
• Data modelling
• M.Sc or B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA

Good to have

• R
• Data structures
• Power BI
• Data privacy
• Spark
• Tableau