Big Data Engineer II | Apply Now

About the role

The Data Engineer is responsible for designing, building, and maintaining scalable data engineering solutions that enable reliable, secure, and high-quality data for analytics, reporting, and business decision-making. This role plays a critical part in the data and analytics lifecycle by developing production-grade data platforms and pipelines across cloud and on-premises environments.

What you'll do

• Design, build, and maintain robust ETL/ELT pipelines on Azure cloud and on-premises platforms for batch and real-time data processing
• Develop scalable data solutions to collect, ingest, transform, and store large volumes of structured and unstructured data
• Monitor, optimize, and troubleshoot data pipelines to ensure high availability, reliability, scalability, and performance
• Ensure adherence to data governance, security, privacy, compliance, and quality standards across all data engineering solutions
• Develop and implement data architectures including data lakes, data warehouses, data marts, and Medallion architecture frameworks

What you need

• 5–8 yrs of experience
• SQL
• ETL
• Python
• Spark
• Databricks
• Azure Data Factory
• B.Sc or B.Tech or B.E. or BCA

Good to have

• LLMs
• CI/CD
• Shell scripting
• MongoDB
• Git
• Hadoop