Lead Developer

About the role

Serve as a senior technical expert acting as a lead developer in data engineering initiatives that use SQL Azure Databricks Azure Data Lake Store and Azure Data Factory to build scalable data solutions in a hybrid work model. Contribute to high quality data platforms that support investment banking focused analytics and operational reporting in a collaborative day shift environment.

What you'll do

• Design robust data engineering solutions using SQL Azure Databricks Azure Data Lake Store and Azure Data Factory to deliver secure and scalable data pipelines for…
• Develop efficient batch and near real time data pipelines that ingest transform and curate structured and semi structured data to enable high quality downstream…
• Implement optimized SQL queries stored procedures and data models that improve query performance reduce compute cost and ensure reliable data access for analytical users…
• Configure and maintain Azure Databricks clusters notebooks and jobs to orchestrate data transformations while managing resource utilization and promoting consistent…
• Build and manage Azure Data Factory pipelines triggers and activities to automate data movement across diverse sources and sinks while enforcing standardized patterns…

What you need

• SQL
• Azure Data Factory
• Investment banking
• Azure
• Databricks
• ETL

Good to have

• Data warehousing
• Data modelling
• Root cause analysis
• Reconciliation