Lead I - Data Engineering

About the role

Design and develop scalable data pipelines using Azure Data Factory (ADF). Develop data processing solutions using Azure Databricks and PySpark. Build and maintain data warehouses and data lakes using Azure services. Develop ETL/ELT processes for structured and unstructured data. Write complex SQL queries, stored procedures, and performance-optimized data transformations.

What you'll do

• Design and develop scalable data pipelines using Azure Data Factory (ADF)
• Develop data processing solutions using Azure Databricks and PySpark
• Build and maintain data warehouses and data lakes using Azure services
• Develop ETL/ELT processes for structured and unstructured data
• Write complex SQL queries, stored procedures, and performance-optimized data transformations

What you need

• 5–7 years in data science & ai
• SQL
• Python
• Azure Data Factory
• Data warehousing
• ETL
• Databricks
• Any graduate

Good to have

• Kafka
• Terraform
• Power BI
• Spark
• Data modelling
• Azure