Senior Data Engineer – Financial Services

About the role

We are seeking seasoned Data Engineering and architecture leaders to architect and deliver a next-generation data lake/house platform for a leading financial services client. This engagement will involve thorough data architecture and engineering components, analysis of complex data and its ecosystem and integrating real-time trade, crypto, securities and fixed income data, analytics, and risk systems for various use-cases.

What you'll do

• Architect and lead the design, implementation, and optimization of large-scale data lake/house systems on Azure Databricks using Spark, Delta Lake, and Python. (advanced)
• Build and optimize streaming pipelines for real-time ingestion, processing, and analytics of trade and market data across asset classes (FX, equities, futures, options
• Collaborate closely with the CTO and data architects to evolve the end-to-end application architecture for scalability, resilience
• Mentor and guide junior and mid-level engineers, establishing best practices in data modelling, orchestration, and operational monitoring
• Ensure data integrity, lineage, and governance within regulatory and compliance frameworks. (advanced)

What you need

• Machine learning
• Python
• Spark
• Databricks
• AWS
• Data modelling

Good to have

• Microservices
• Shopify
• Kafka
• Azure
• ETL
• Capital markets