Data Engineer

About the role

We are looking for a Senior Data Engineer who is equally strong on the data side (modelling, data quality, SQL, understanding the business) and the engineering side (Python, PySpark, CI/CD, performance, reliability). You will own the design and delivery of production data platforms from requirements to production support, work directly with clients, and share your knowledge with the wider engineering team.

What you'll do

• Own the design and delivery of data pipelines and platforms end to end: requirements, architecture, build, testing, deployment and production support
• Design data models (dimensional, SCD, Medallion Bronze/Silver/Gold) that match how the business actually uses the data
• Build and maintain scalable ETL/ELT pipelines using Python, SQL, PySpark and Azure Data Factory on Azure Databricks or Microsoft Fabric
• Implement batch, incremental/CDC and streaming loads, and tune Spark and SQL performance and cost
• Build data quality checks, monitoring and alerting into every pipeline, and apply governance, lineage and access controls

What you need

• 6–15 years in data science & ai
• SQL
• Python
• ETL
• Spark
• Azure Data Factory
• Databricks
• Any graduate

Good to have

• Kafka
• Terraform
• Unity
• Azure
• CI/CD
• Power BI