Data Engineer(Azure) - Chennai/Banglore/Hyderabad/Trivandrum

About the role

We are seeking a Data Engineer to work on a Generative AI initiative to join our team. The ideal candidate will have a deep understanding of data modeling, data schemas and has developed ETLs from various sources eensuring high data availability, fault tolerance and security and governance.

What you'll do

• Collaborate with stakeholders to understand data requirements and design scalable and efficient data models, schemas, and architectures on the Azure platform
• Develop and implement data integration and ETL (Extract, Transform, Load) processes to ingest, transform
• Build and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Databricks, or similar tools to automate the movement and transformation of data
• Optimize data storage and retrieval mechanisms, ensuring high data availability, fault tolerance, and efficient query performance
• Monitor and troubleshoot data pipelines, identifying and resolving performance issues, data quality problems, and data integration challenges

What you need

• Azure
• SQL
• ETL
• Python
• Databricks
• Azure Data Factory
• B.Tech or B.E. or B.Sc or BCA or M.Tech or MCA or M.Sc

Good to have

• Spark
• Hadoop
• Machine learning
• NoSQL
• Statistics
• Physics