Analyst/Consultant - Data Engineer - Azure (INDM)

About the role

Analyst/Consultant - Data Engineer - Azure (INDM) at Blue Altair. Data Pipeline Development.

What you'll do

• Design and implement data pipelines to efficiently deliver data to the Business Intelligence (BI) team
• Create and manage Azure Data Factory (ADF) pipelines to extract data from various sources and load it into Azure Blob Storage (Bronze layer)
• Develop pipelines using Azure Databricks to process and transform data from the bronze layer into the silver layer, creating intermediate tables
• Build and maintain pipelines to transform silver layer data into Gold layer fact and dimension tables, ensuring the data is ready for analysis by the BI team
• Monitor, troubleshoot, and optimize all data pipelines to ensure they run smoothly and efficiently

What you need

• 3–5 yrs of experience
• Azure
• Python
• Azure Data Factory
• Databricks
• Spark
• SQL
• Any graduate

Good to have

• ETL
• NoSQL
• MongoDB
• Cassandra