Azure Big Data Engineer | 4 to 8 Yrs | WFO | SOW 2024 2579

About the role

Overall 4 to 8 years of experience with a minimum 4+ years of relevant professional work experience. ADF, ETL Pipelines, Unity Catalog, Azure SQL Database, SQL Coding, Azure SQL Database, Azure Data Lake. Utilizing Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations using ADF pipelines.

What you'll do

• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure
• Work together with data analysts to understand the needs for data and create effective data workflows
• Use ADF pipelines to orchestrate the end to end data transformation including the execution of DataBricks notebooks
• Creating and managing Azure infrastructure across the landscape using Bicep
• Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data

What you need

• 5–9 yrs of experience
• Azure
• SQL
• ETL
• Databricks
• Spark
• CI/CD
• Any graduate

Good to have

• Power BI
• Power Automate
• PowerShell
• Azure Data Factory
• Unity