Data Engineer(Azure) - Chennai/Banglore/Hyderabad/Trivandrum
Chennai, BengaluruFull-timeJunior levelPosted open since nov 2023
Data science role at Fa Ertb Saasfaprod1 in Chennai and Bengaluru. Needs a B.Tech, B.E. or B.Sc.
About the role
We are seeking a Data Engineer to work on a Generative AI initiative to join our team. The ideal candidate will have a deep understanding of data modeling, data schemas and has developed ETLs from various sources eensuring high data availability, fault tolerance and security and governance.
What you'll do
- Collaborate with stakeholders to understand data requirements and design scalable and efficient data models, schemas, and architectures on the Azure platform
- Develop and implement data integration and ETL (Extract, Transform, Load) processes to ingest, transform
- Build and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Databricks, or similar tools to automate the movement and transformation of data
- Optimize data storage and retrieval mechanisms, ensuring high data availability, fault tolerance, and efficient query performance
- Monitor and troubleshoot data pipelines, identifying and resolving performance issues, data quality problems, and data integration challenges
What you need
- Azure
- SQL
- ETL
- Python
- Databricks
- Azure Data Factory
Good to have
- Spark
- Hadoop
- Machine learning
- NoSQL
- Statistics
- Physics